-- Logs begin at Tue 2022-10-04 13:46:51 UTC, end at Tue 2022-10-04 14:47:38 UTC. -- Oct 04 14:20:30.220067 dv-cinder-860260-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 14:20:30.229889 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 14:20:30 2022] *** Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: nodename: dv-cinder-860260-1-iscsi Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: machine: x86_64 Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: clock source: unix Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: pcre jit disabled Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: detected number of CPU cores: 4 Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: current working directory: / Oct 04 14:20:30.231886 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: detected binary path: /usr/bin/uwsgi-core Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: your processes number limit is 47680 Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: your memory page size is 4096 bytes Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: detected max file descriptor number: 2048 Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: lock engine: pthread robust mutexes Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: thunder lock: enabled Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 14:20:30.232613 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 14:20:30.274325 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: Python main interpreter initialized at 0x55e0786ce9c0 Oct 04 14:20:30.274325 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: python threads support enabled Oct 04 14:20:30.274325 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: your server socket listen backlog is limited to 100 connections Oct 04 14:20:30.274325 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: your mercy for graceful operations on workers is 90 seconds Oct 04 14:20:30.274735 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 14:20:30.274735 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: *** Operational MODE: preforking *** Oct 04 14:20:30.275026 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: *** uWSGI is running in multiple interpreter mode *** Oct 04 14:20:30.275026 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: spawned uWSGI master process (pid: 105570) Oct 04 14:20:30.275246 dv-cinder-860260-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 14:20:30.276967 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: spawned uWSGI worker 1 (pid: 105571, cores: 1) Oct 04 14:20:30.276967 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: spawned uWSGI worker 2 (pid: 105572, cores: 1) Oct 04 14:20:30.276967 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 14:20:30.965460 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 14:20:30.969603 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 14:20:32.095127 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:20:32.095127 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: from cryptography.utils import int_from_bytes Oct 04 14:20:32.095968 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:20:32.095968 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: from cryptography.utils import int_from_bytes Oct 04 14:20:32.096395 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:20:32.096395 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: from cryptography.utils import int_from_bytes Oct 04 14:20:32.096512 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:20:32.096512 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: from cryptography.utils import int_from_bytes Oct 04 14:20:34.740303 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 14:20:34.740902 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 14:20:34.740998 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 14:20:34.741354 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 14:20:34.741454 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 14:20:34.741546 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 14:20:34.741624 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 14:20:34.741701 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 14:20:34.741991 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 14:20:34.742103 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.742247 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 14:20:34.742356 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.742632 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.742742 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.742963 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.743304 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.743304 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.743872 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.746847 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747007 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747138 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747315 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747456 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747599 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747740 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747879 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.747879 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748133 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748271 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748421 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748421 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748648 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860260-1-iscsi {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748788 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.748938 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749072 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860260-1-iscsi {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749196 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749293 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749402 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749538 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749666 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749770 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749875 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.749992 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750089 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750200 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750325 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750451 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750594 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750749 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.750899 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751027 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751179 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751478 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751610 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751745 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.751883 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.752048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.752181 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.752438 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.753154 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.753324 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.753893 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.754103 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.754306 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.754499 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.754667 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.754808 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.754946 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.755082 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860260-1-iscsi {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.755239 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.755393 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.755393 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.755729 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860260-1-iscsi {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.755890 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.756045 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.756206 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.756351 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.756500 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.756678 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.756896 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757055 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757197 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757338 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757497 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757641 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757792 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.757998 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.758158 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.758306 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.758467 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.758612 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.758753 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.758894 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759038 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759249 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759402 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759543 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759691 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759833 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.759989 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760136 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760230 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760329 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760458 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760546 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760688 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760844 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.760997 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.761137 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.761281 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.761441 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.761692 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.761836 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.761998 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762158 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762310 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762520 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762674 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762674 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762838 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.762955 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763037 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763037 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763192 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763278 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763357 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763456 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763598 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763750 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.763894 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764034 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764233 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764395 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764555 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764696 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764837 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.764974 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765135 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765273 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765422 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765562 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765700 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765852 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.765998 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.766134 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.766301 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.766461 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.766619 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.766758 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.766925 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.767130 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.767293 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.767428 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.767574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.767723 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.767862 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768025 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768172 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768336 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768479 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768619 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768757 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.768914 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769070 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769211 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769349 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769630 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769782 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.769931 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770085 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770234 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770234 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770641 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770781 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.770920 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771068 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771206 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771418 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771559 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771700 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771841 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.771971 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.772125 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.772278 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.772632 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.772782 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.772940 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773079 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773219 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773378 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773528 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773668 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773807 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.773993 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.774151 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.774349 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.774492 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.774636 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.774782 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.774917 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.775057 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.775207 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.775348 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.775760 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.775905 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776046 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776199 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776375 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776519 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776655 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776807 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.776946 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777097 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777302 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777442 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777577 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777812 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.777969 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778087 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778201 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778323 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778457 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778608 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778763 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.778908 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779045 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779199 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779337 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779477 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779641 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779776 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.779912 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780066 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780217 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780381 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780543 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780687 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780829 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.780967 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.781104 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.781245 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.781463 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.781617 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.781763 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.781902 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.782057 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.782196 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.782350 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.783043 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.783255 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.783403 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.783561 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.783715 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.783855 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.784037 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.784486 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.784633 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.784783 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.784940 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785078 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785217 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785356 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785496 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785623 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785776 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.785921 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786062 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786208 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786348 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786492 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786492 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786777 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786918 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.786918 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.787180 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.787339 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.787498 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.787639 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.787780 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.787938 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.788048 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.788212 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.788300 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.788397 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.788475 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.788564 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.788644 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:20:34.788734 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.788817 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.788955 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789096 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789245 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789388 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789547 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789689 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789837 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.789977 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790117 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790268 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790407 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790559 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790709 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790848 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.790989 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.791143 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.791288 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.791427 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.791565 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.791706 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.791872 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792043 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792196 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792368 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792536 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792677 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792830 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.792985 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.793139 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.793352 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.793502 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.793659 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.793802 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.793965 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.794120 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.794264 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.794409 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.794619 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.794756 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.794913 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795075 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795220 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795361 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795511 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795666 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795808 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.795958 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796101 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796220 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796303 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796429 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796573 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796727 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.796880 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797031 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797172 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797330 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797472 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797606 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797758 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.797899 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.798042 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.798279 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.798929 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.799288 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.799438 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.799598 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.799846 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800006 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800150 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800294 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800463 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800611 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800777 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.800959 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801094 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801183 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801183 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801341 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801483 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801610 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801752 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.801898 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802044 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802200 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802361 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802505 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802651 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802793 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.802936 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803089 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803233 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803372 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803495 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803636 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803777 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.803928 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.804078 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.804222 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.804519 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.804712 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.804861 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805025 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805171 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805315 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805467 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805554 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805629 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805796 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.805939 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806064 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806204 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806366 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806519 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806662 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806788 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.806939 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.807092 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.807249 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.807389 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.807533 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.807724 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.807884 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808029 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808184 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808406 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808572 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808710 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808846 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.808985 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.809139 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.809295 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.809420 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.809543 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.809684 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.809836 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810088 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810214 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810337 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810474 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810605 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810725 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810799 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.810917 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.811055 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.811196 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.811338 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.811494 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.811697 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.811844 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812002 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812140 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812292 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812481 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812644 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812788 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.812961 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.813103 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.813263 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.813417 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.813566 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.813726 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.813916 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.814055 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.814210 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.814351 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.816443 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.816608 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.816754 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.816902 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.817069 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.817227 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.817375 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.817531 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.817531 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.817819 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818042 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818192 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818340 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818495 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818637 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818773 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.818926 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819062 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819198 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819486 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819644 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819789 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.819935 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820075 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820222 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820386 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820548 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820694 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820841 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.820983 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.821124 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.821266 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.821424 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.821581 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.821727 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.821872 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822017 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822163 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822327 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822485 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822634 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822775 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.822916 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.823073 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.823217 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.823360 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.823503 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.823647 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.823865 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.824026 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.824169 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.824363 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.824507 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.824709 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.824858 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825009 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825157 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825301 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825445 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825599 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825832 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.825993 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.826140 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.826282 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.826427 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.826568 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.826732 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.826876 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827042 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827188 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827334 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827648 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827792 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.827938 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828086 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828227 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828413 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828582 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828719 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828860 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.828999 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.829143 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.829288 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.829473 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.829622 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.829770 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.829916 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830061 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830220 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830366 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830525 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830701 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830847 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.830991 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.831155 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.831311 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.831457 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.831601 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.831746 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.831904 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.832060 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.832216 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.832445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.832592 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.832738 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.832882 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.833044 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.833190 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.833337 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.833480 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.833625 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.833769 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834001 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834149 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834294 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834439 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834582 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834802 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.834948 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.835095 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.835241 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.835385 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.835527 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.835692 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.835851 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836018 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836161 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836328 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836476 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836638 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836788 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.836931 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.837111 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.837257 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.837404 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.837562 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.837700 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.837849 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838002 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838138 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838291 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838429 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838564 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838708 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838852 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.838994 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.839152 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.839295 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.839440 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.839585 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.839742 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.839901 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.840156 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.840302 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.840595 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.840741 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.840886 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841031 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841200 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841344 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841634 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841780 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.841945 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.842107 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.842263 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.842420 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.842562 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.842707 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.842873 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843018 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843174 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843322 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843466 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843611 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843778 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.843927 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.844160 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.844332 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.844480 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.844621 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.844779 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.844920 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.845591 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.845722 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.845849 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846054 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846186 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846327 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846471 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846610 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846763 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.846928 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847074 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847215 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847356 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847498 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847638 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847802 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.847947 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.848089 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.848287 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.848491 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.848644 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.848850 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.848993 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849129 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849268 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849420 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849580 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849580 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849839 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.849976 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850114 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850252 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850402 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850402 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850661 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850868 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.850992 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851132 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851287 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851430 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851581 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851734 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851734 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851976 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.851976 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.852293 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.852464 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.852557 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.852637 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.852729 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.852868 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853023 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853165 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853318 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853473 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853627 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853782 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.853782 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.854067 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.854211 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.854354 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.854482 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855017 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855164 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855338 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855494 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855638 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855780 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.855923 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.856139 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.856297 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.856464 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.856609 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.856757 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.856914 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857072 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857216 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857361 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857513 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857658 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857799 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.857952 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.858098 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.858237 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.858444 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.858591 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.858747 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.858917 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859060 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859200 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859342 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859483 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859628 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859791 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859933 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.859933 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.860205 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.860422 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.860591 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.860735 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.861338 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.861447 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.861569 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.861714 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.861850 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.861993 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.862135 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.862276 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.862420 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.862572 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.862727 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.862867 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863018 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863158 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863297 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863297 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863579 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863579 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863837 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.863837 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.864114 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.864467 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.864467 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.864735 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.864879 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865208 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865380 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865380 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865658 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865658 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.865914 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.866059 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.866274 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.866433 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.866577 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.866725 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.866870 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867027 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867173 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867314 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867457 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867599 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867743 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.867900 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.868044 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.868187 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.868409 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.868552 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.868696 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.868857 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869001 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869143 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869243 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869320 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869399 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869479 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869560 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869626 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869696 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869762 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869853 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.869995 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870134 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870273 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870413 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870554 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870706 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870847 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.870986 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.871124 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.871273 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.871419 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.871581 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.871725 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.871868 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872012 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872167 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872333 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872499 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872647 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872792 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.872937 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873082 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873237 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873395 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873395 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873665 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873809 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.873933 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874029 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874112 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874112 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874254 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874326 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874392 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874476 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874611 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874762 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.874913 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875052 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875192 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875332 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875472 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875614 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875754 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.875894 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.876055 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.876199 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.876530 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.876685 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.876830 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.876974 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877136 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877293 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877441 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877581 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877695 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877695 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877833 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877833 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.877966 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878031 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878095 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878161 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878295 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878440 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878629 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878778 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.878922 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879080 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879226 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879371 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879527 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879672 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879817 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.879985 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.880139 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.880282 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.880493 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.880625 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.880786 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.880920 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881051 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881191 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881351 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881495 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881639 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881794 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.881947 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882089 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882226 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882371 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882490 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882587 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882677 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882745 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882810 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.882886 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883002 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883144 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883284 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883423 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883562 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883701 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.883856 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884008 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884150 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884300 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884481 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884676 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884837 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.884980 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.885138 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.885292 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.885487 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.885633 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.885794 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.885926 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.886081 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.886224 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.886371 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.886582 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.886739 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.886891 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887046 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887198 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887337 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887487 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887643 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887786 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.887931 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.888071 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.888217 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.888401 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.888547 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.888758 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.888909 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889056 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889212 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889373 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889513 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889651 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889790 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.889947 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.890202 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.890348 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.890487 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.890644 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.890787 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.890787 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.891063 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.891209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.891373 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.891528 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.891685 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.891831 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.892023 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.892163 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.892370 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.892370 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.892642 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.892801 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893009 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893164 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893309 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893456 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893601 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893758 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.893905 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894048 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894190 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894331 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894475 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894640 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894847 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.894995 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.895140 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.895295 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.895439 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.895653 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.895799 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.895940 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.896089 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.896230 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.896403 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.896571 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.896729 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.896871 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897012 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897153 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897308 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897460 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897602 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897749 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.897924 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.898072 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.898275 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.898422 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.898564 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.898704 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.898907 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.899052 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.899211 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.899314 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.899479 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.899566 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.899871 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.900021 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.900182 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.900400 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.900918 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901062 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901202 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901342 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901483 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901624 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901785 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.901928 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.902069 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.902211 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.902415 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.902581 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.902726 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.902882 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903027 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903170 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903321 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903477 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903621 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903766 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903858 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.903974 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.904197 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.904443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.904590 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.904740 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.904957 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.905105 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.905257 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.905416 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.905573 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.905720 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.905861 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906025 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906176 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906318 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906460 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906614 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906819 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.906963 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.907128 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.907283 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.907429 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.908073 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.908183 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.908298 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.908521 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.908751 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.908911 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.909111 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.909272 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.909404 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.909552 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.909724 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.909882 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910029 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910171 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910324 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910470 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910644 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910790 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.910937 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911081 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911240 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911383 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911528 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911673 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911847 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.911998 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.912162 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.912346 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.912492 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.912654 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.912790 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.912945 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.913100 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.913247 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.913390 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.913531 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.913701 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.913867 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.914020 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.914109 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.914329 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.914485 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.914629 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.914839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915049 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915193 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915336 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915479 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915619 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915827 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.915992 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.916148 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.916290 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.916574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.916718 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.916925 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917077 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917219 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917362 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917507 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917671 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917798 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.917942 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918084 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918232 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918371 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918537 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918683 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918683 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.918958 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.919172 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.919323 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.919483 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.919630 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.919790 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.919935 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.920077 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.920236 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.920421 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.920585 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.920740 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.920887 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921033 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921188 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921335 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921482 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921625 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921736 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.921891 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922049 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922196 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922349 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922512 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922654 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922654 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.922939 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.923085 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.923787 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.923922 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924045 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924171 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924349 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924349 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924551 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924631 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.924895 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925036 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925214 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925362 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925505 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925646 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925801 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.925937 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.926153 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.926312 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.926453 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.926595 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.926765 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.926922 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.927063 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.927214 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.927367 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.927510 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.927691 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.927861 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.928009 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.928266 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.928524 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.928666 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.928829 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.928975 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.929120 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.929258 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.929400 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.929542 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.929699 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.929858 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930146 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930291 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930434 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930694 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930840 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.930986 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.931133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.931309 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.931470 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.931616 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.931761 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.931937 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.932038 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.932247 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.932425 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.932596 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.932759 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.932903 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933044 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933214 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933378 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933521 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933671 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933814 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.933955 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.934114 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.934256 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.934403 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.934548 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.934734 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.934884 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.935042 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.935247 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.935395 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.935555 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.935699 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.935851 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936077 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936227 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936393 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936537 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936684 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936840 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.936986 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.937188 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.937337 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.937486 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.937653 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.937816 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.937968 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.938115 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.938259 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.938414 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.938575 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.938716 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.938860 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.939003 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.939182 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.939403 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.939663 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.939837 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.939987 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.940146 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.940285 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.940454 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.940618 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.940865 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941017 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941161 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941320 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941504 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941664 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941837 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.941988 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.942164 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.942314 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.942459 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.942546 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.942788 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.942957 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.943095 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.943236 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.943409 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.943569 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.943716 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.943944 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.944107 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.944253 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.944457 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.944604 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.944744 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.944919 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.945049 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.945234 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.945365 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.945522 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.945667 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.945845 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.946004 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.946149 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.946288 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.946460 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.946683 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.946777 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947041 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947203 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947346 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947487 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947631 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947784 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.947929 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.948085 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.948238 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.948508 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.948669 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.948878 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949046 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949192 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949337 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949476 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949476 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949740 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.949898 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950052 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950197 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950338 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950481 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950629 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950794 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.950997 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.951141 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.951241 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.951363 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.951546 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.951670 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.951859 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952024 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952169 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952357 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952532 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952676 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952822 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.952975 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.953124 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.953269 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.953428 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.953571 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.953717 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.953860 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954005 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954157 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954306 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954471 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954600 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954718 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.954993 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.955176 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.955323 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.955861 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956171 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956299 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956567 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956678 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956750 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956816 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956880 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.956953 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957102 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957244 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957372 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957517 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957662 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957806 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.957968 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958108 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958248 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958390 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958532 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958660 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958837 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.958933 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.959147 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.959253 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.959458 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.959723 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.959867 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.960012 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.960155 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.960295 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.960462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.960630 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.960770 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961035 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961187 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961345 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961501 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961663 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961804 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.961945 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.962085 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.962228 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.962381 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.962536 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.962678 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.962848 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963009 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963152 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963309 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963577 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963810 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.963974 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.964129 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.964384 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.964540 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.964700 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.964846 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965033 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965185 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965348 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965491 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965709 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965821 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.965929 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966070 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966244 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966398 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966543 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966689 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966833 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.966992 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.967146 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.967247 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.967463 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.967619 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.967768 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.967928 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968074 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968218 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968404 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968551 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968708 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968854 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.968998 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.969156 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.969302 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.969434 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.969564 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.969753 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.969904 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.970575 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.970725 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.970872 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.971151 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.971277 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.971459 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.971606 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.971779 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.971932 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.972096 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.972245 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.972451 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.972600 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.972746 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.972909 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.973221 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.973422 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.973574 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.973740 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.973877 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.974072 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.974243 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.974518 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.974668 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.974809 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.974918 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975016 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975119 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975327 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975484 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975633 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975793 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.975942 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.976086 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.976246 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.976421 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.976589 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.976936 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977076 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977264 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977415 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977591 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977729 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977893 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.977989 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.978200 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.978287 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.978505 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.978602 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.978821 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.978933 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.979129 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.979223 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.979440 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.979538 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.979748 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.979851 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980053 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980195 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980371 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980542 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980677 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980822 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.980961 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.981111 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.981264 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.981412 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.981566 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.981713 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.981872 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982004 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982140 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982285 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982438 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982592 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982736 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.982874 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983030 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983172 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983313 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983453 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983598 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983740 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.983904 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984047 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984191 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984359 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984506 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984680 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984830 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.984975 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.985121 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.985264 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.985407 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.986563 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.986721 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.986869 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.987017 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.987379 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.987540 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.987540 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.987820 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.987967 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.988116 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.988273 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.988515 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.988685 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.988832 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.988832 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989085 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989229 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989388 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989534 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989681 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989825 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.989954 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.990105 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.990428 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.990586 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.990735 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.990882 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991029 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991177 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991338 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991501 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991660 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991808 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.991957 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.992104 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.992273 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.992507 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.992657 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.992804 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.992961 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.993112 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.993266 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.993414 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.993567 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.993708 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.993860 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994018 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994163 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994306 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994451 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994594 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994741 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.994895 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995036 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995176 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995318 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995470 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995631 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995771 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.995897 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996035 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996156 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996296 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996480 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996623 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996750 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.996886 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997028 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997168 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997333 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997634 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997774 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.997902 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998053 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998192 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998279 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998359 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998425 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998499 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998614 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998703 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.998922 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.999010 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.999231 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.999355 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.999537 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.999670 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:34.999851 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.000018 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.000160 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.000444 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.000534 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.000764 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.000850 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.001079 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.001167 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.001415 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.001508 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.001793 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 14:20:35.002040 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.002583 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.002922 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.003261 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.003620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.003945 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.004288 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.004649 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.004968 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.005285 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.005588 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:20:35.005835 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 14:20:35.160566 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO dbcounter [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Registered counter for database nova_api Oct 04 14:20:35.165737 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO dbcounter [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Registered counter for database nova_api Oct 04 14:20:35.183180 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_db.sqlalchemy.engines [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.188693 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_db.sqlalchemy.engines [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.190974 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writer thread running {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.196660 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writer thread running {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.252812 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.context [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d0b2b96-fdc7-4407-8ca1-86c8c8070a51(cell1) {{(pid=105571) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 14:20:35.257657 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_concurrency.lockutils [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:20:35.258280 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_concurrency.lockutils [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:20:35.258699 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.context [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d0b2b96-fdc7-4407-8ca1-86c8c8070a51(cell1) {{(pid=105572) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 14:20:35.260252 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_concurrency.lockutils [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:20:35.261067 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_concurrency.lockutils [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:20:35.261526 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_concurrency.lockutils [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:20:35.262731 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:20:35.263215 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:20:35.263582 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_concurrency.lockutils [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:20:35.264820 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:20:35.265583 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:20:35.265769 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO dbcounter [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Registered counter for database nova_cell0 Oct 04 14:20:35.266029 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:20:35.269112 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:20:35.271217 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO dbcounter [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Registered counter for database nova_cell0 Oct 04 14:20:35.271483 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO dbcounter [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Registered counter for database nova_cell1 Oct 04 14:20:35.275428 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO dbcounter [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Registered counter for database nova_cell1 Oct 04 14:20:35.281179 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_db.sqlalchemy.engines [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.283937 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_db.sqlalchemy.engines [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.286359 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_db.sqlalchemy.engines [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.288297 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writer thread running {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.291837 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_db.sqlalchemy.engines [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.293279 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writer thread running {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.294142 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writer thread running {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.444501 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writer thread running {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.450446 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO dbcounter [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Registered counter for database nova_cell0 Oct 04 14:20:35.456272 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG oslo_db.sqlalchemy.engines [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.458658 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO dbcounter [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Registered counter for database nova_cell0 Oct 04 14:20:35.462184 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writer thread running {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.466554 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_db.sqlalchemy.engines [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:20:35.473093 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writer thread running {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:20:35.815655 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: WARNING keystonemiddleware.auth_token [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:20:35.822316 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: WARNING keystonemiddleware.auth_token [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:20:35.823306 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: WARNING keystonemiddleware.auth_token [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:20:35.830738 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: WARNING keystonemiddleware.auth_token [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:20:36.179296 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: WARNING keystonemiddleware.auth_token [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:20:36.181623 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: WARNING keystonemiddleware.auth_token [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:20:36.185333 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: WARNING keystonemiddleware.auth_token [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:20:36.187602 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: WARNING keystonemiddleware.auth_token [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:20:36.190996 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0786ce9c0 pid: 105571 (default app) Oct 04 14:20:36.192984 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0786ce9c0 pid: 105572 (default app) Oct 04 14:20:36.193133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:20:36.194341 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-4143cae8-8974-4819-8319-00b0ffa44eed None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001819 Oct 04 14:20:36.194757 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Tue Oct 4 14:20:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:10.442602 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:10.443849 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Oct 04 14:22:10.444258 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:10.463933 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_api:SELECT=3 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:10.465752 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_cell1:SELECT=3 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:10.467114 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_cell0:SELECT=3 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:10.470510 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:11.745641 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-480cb506-89ae-4ffb-b2d4-0b1b786271e6 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:11.789815 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-480cb506-89ae-4ffb-b2d4-0b1b786271e6 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.334334 Oct 04 14:22:11.791166 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 2/3] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Oct 4 14:22:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:15.340816 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:15.342734 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-8982601d-c4ce-44ab-b17c-02fa85f67414 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Oct 04 14:22:15.344117 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 2/4] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:16.081617 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-81e45e0c-4a57-41a8-a685-02a18510d342 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:16.146935 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-81e45e0c-4a57-41a8-a685-02a18510d342 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.790023 Oct 04 14:22:16.147113 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 3/5] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:16.169065 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_api:SELECT=3 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:16.170489 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_cell0:SELECT=3 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:16.173623 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_cell1:SELECT=3 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:16.175076 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:16.434953 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-fdd5bfcb-a39f-464e-a6c0-c5ae2ed9f216 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:16.543018 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-fdd5bfcb-a39f-464e-a6c0-c5ae2ed9f216 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384605 Oct 04 14:22:16.543616 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 3/6] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Oct 4 14:22:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:22:19.902300 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-81e45e0c-4a57-41a8-a685-02a18510d342 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:19.904179 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-81e45e0c-4a57-41a8-a685-02a18510d342 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002576 Oct 04 14:22:19.905744 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 4/7] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:20.702036 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-c787721b-5faa-47df-8333-bdaf8015a150 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:20.761316 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-c787721b-5faa-47df-8333-bdaf8015a150 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.846066 Oct 04 14:22:20.762668 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 4/8] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 14:22:20.784060 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-517fb7e2-e2b4-4b2d-bc6a-1e7e05aebe47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:20.856930 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-517fb7e2-e2b4-4b2d-bc6a-1e7e05aebe47 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080166 Oct 04 14:22:20.857992 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 5/9] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Oct 4 14:22:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:24.112501 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-c787721b-5faa-47df-8333-bdaf8015a150 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:24.113781 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-c787721b-5faa-47df-8333-bdaf8015a150 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002512 Oct 04 14:22:24.114470 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:24.802032 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-cff5ce74-aa20-425e-82f2-a26902655954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:24.832967 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-cff5ce74-aa20-425e-82f2-a26902655954 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.705914 Oct 04 14:22:24.834178 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 6/11] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:24.851258 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-82c8302f-c9f2-4a6c-b571-e53c4a9174f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:24.909171 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-82c8302f-c9f2-4a6c-b571-e53c4a9174f1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062171 Oct 04 14:22:24.911096 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 6/12] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Oct 4 14:22:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:22:28.455961 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-cff5ce74-aa20-425e-82f2-a26902655954 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:28.458749 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-cff5ce74-aa20-425e-82f2-a26902655954 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003060 Oct 04 14:22:28.459477 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 7/13] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:29.371550 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-0b3052f6-1b19-4b69-90eb-9cba22017f87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:29.430214 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-0b3052f6-1b19-4b69-90eb-9cba22017f87 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.960237 Oct 04 14:22:29.432457 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 7/14] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 14:22:29.452539 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-be3135d8-4092-478b-ad81-683fccff11d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:29.508646 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-be3135d8-4092-478b-ad81-683fccff11d0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062162 Oct 04 14:22:29.509735 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 8/15] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Oct 4 14:22:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:33.706964 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-0b3052f6-1b19-4b69-90eb-9cba22017f87 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:33.707936 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-0b3052f6-1b19-4b69-90eb-9cba22017f87 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 04 14:22:33.708504 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 8/16] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:34.443175 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-242eab0a-fca6-46a3-9c17-7b966300e066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:34.477378 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-242eab0a-fca6-46a3-9c17-7b966300e066 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.761047 Oct 04 14:22:34.478374 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 9/17] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:34.493156 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-ba394f68-d50b-4113-b793-245377e54304 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:34.532240 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-ba394f68-d50b-4113-b793-245377e54304 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044379 Oct 04 14:22:34.533296 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 9/18] 10.222.0.64 () {64 vars in 1336 bytes} [Tue Oct 4 14:22:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:37.487428 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-242eab0a-fca6-46a3-9c17-7b966300e066 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:37.489205 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-242eab0a-fca6-46a3-9c17-7b966300e066 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Oct 04 14:22:37.489629 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 10/19] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:22:38.150135 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-3e9b1aa5-e201-4662-873f-d43057115922 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:38.200018 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-3e9b1aa5-e201-4662-873f-d43057115922 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.702141 Oct 04 14:22:38.200949 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 10/20] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Oct 4 14:22:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:22:41.183260 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-242eab0a-fca6-46a3-9c17-7b966300e066 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:41.185253 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-242eab0a-fca6-46a3-9c17-7b966300e066 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002621 Oct 04 14:22:41.186121 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 11/21] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:41.810825 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-80ffc09e-3e2c-4c3c-8ab7-3ca85bf415f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:41.838872 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-80ffc09e-3e2c-4c3c-8ab7-3ca85bf415f2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.641078 Oct 04 14:22:41.839776 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 11/22] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:41.854230 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-ec7df635-441b-415c-bae3-8824a62020bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:41.860469 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:41.897537 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-ec7df635-441b-415c-bae3-8824a62020bd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048631 Oct 04 14:22:41.898733 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 12/23] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Oct 4 14:22:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:45.655076 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-80ffc09e-3e2c-4c3c-8ab7-3ca85bf415f2 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:45.657200 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-80ffc09e-3e2c-4c3c-8ab7-3ca85bf415f2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002784 Oct 04 14:22:45.657853 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:46.358104 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-1d2081c2-ff4e-4113-a420-e6123427401b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:46.381353 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-1d2081c2-ff4e-4113-a420-e6123427401b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.712266 Oct 04 14:22:46.381908 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 13/25] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:46.396041 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-0cac8430-0848-45ab-8e42-15dbbb4face4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:46.432855 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-0cac8430-0848-45ab-8e42-15dbbb4face4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041096 Oct 04 14:22:46.433980 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 13/26] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Oct 4 14:22:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:49.570565 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-1d2081c2-ff4e-4113-a420-e6123427401b admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:49.572255 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-1d2081c2-ff4e-4113-a420-e6123427401b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Oct 04 14:22:49.572735 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 14/27] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:22:50.335561 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-05976b45-74c8-46fe-a83a-265edb37f17b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:50.343680 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:22:50.362150 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-05976b45-74c8-46fe-a83a-265edb37f17b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.779030 Oct 04 14:22:50.362477 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 14/28] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:50.379734 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-8b2955b2-56be-49c1-8fc6-14e3acfbdf82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:50.430970 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-8b2955b2-56be-49c1-8fc6-14e3acfbdf82 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059270 Oct 04 14:22:50.432237 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 15/29] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Oct 4 14:22:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:53.910857 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-05976b45-74c8-46fe-a83a-265edb37f17b admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:53.911983 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-05976b45-74c8-46fe-a83a-265edb37f17b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 04 14:22:53.912758 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 15/30] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:54.577031 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-e31760f1-0ee4-4055-b777-ef09b63057f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:54.617606 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-e31760f1-0ee4-4055-b777-ef09b63057f6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.694499 Oct 04 14:22:54.620014 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 16/31] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:54.639700 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-7f0aff3d-a6d1-4118-bbaa-63ecabf95e2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:54.683363 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-7f0aff3d-a6d1-4118-bbaa-63ecabf95e2c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050220 Oct 04 14:22:54.683954 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 16/32] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Oct 4 14:22:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:22:57.871884 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-e31760f1-0ee4-4055-b777-ef09b63057f6 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:22:57.880265 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-e31760f1-0ee4-4055-b777-ef09b63057f6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 04 14:22:57.880265 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 17/33] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:22:58.546825 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-2c993b3a-24f0-484b-8d17-977f551a2d1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "ram": 16384}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:58.569253 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-2c993b3a-24f0-484b-8d17-977f551a2d1c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.688299 Oct 04 14:22:58.570128 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 17/34] 10.222.0.64 () {64 vars in 1283 bytes} [Tue Oct 4 14:22:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:22:58.585362 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-ede07418-e326-4aa0-b57e-4e32605229a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:22:58.608277 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-ede07418-e326-4aa0-b57e-4e32605229a6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029619 Oct 04 14:22:58.612771 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 18/35] 10.222.0.64 () {64 vars in 1333 bytes} [Tue Oct 4 14:22:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:23:12.888557 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-2c993b3a-24f0-484b-8d17-977f551a2d1c admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:12.890414 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-2c993b3a-24f0-484b-8d17-977f551a2d1c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002645 Oct 04 14:23:12.891155 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 18/36] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:12.904045 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:13.465125 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-db2e1551-1469-4d75-89c1-9f9e0e3e4f85 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:13.485397 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-db2e1551-1469-4d75-89c1-9f9e0e3e4f85 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.585879 Oct 04 14:23:13.485969 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 19/37] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Oct 4 14:23:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:23:14.962000 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-2c993b3a-24f0-484b-8d17-977f551a2d1c admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:14.963143 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-2c993b3a-24f0-484b-8d17-977f551a2d1c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Oct 04 14:23:14.963727 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 19/38] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:15.676417 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-9dcc17ee-347e-469a-88f0-e3a260e272fb admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:15.682098 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.wsgi [None req-9dcc17ee-347e-469a-88f0-e3a260e272fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-9dcc17ee-347e-469a-88f0-e3a260e272fb admin admin] Request method failure captured: Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Accept: application/json Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Accept-Encoding: gzip, deflate Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Connection: keep-alive Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Content-Length: 0 Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Host: 10.222.0.64 Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Openstack-Api-Version: compute 2.92 Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Openstack-System-Scope: None Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: User-Agent: python-novaclient Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Auth-Token: gAAAAABjPEHShOd36Rik_FK8KczQBDsuFrIV9NvAigtL5F0IfuWykS_-vGT5Cj0EA-vTEgnpmeP4sREAvsT1hE_2WZmqUOUzXMP1dt80eY1Dk_u2ssLmLHxg6KBT69Xg9eY8fdzBbTioaTzGSAw6oUk-KH3JFJvPQK4Sh4ji0VZKEq5Smr_beWs Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Domain-Id: None Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Domain-Name: None Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Identity-Status: Confirmed Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Is-Admin-Project: True Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Domain-Id: default Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Domain-Name: Default Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Name: admin Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Role: reader,member,admin Oct 04 14:23:15.685432 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Roles: reader,member,admin Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79763f634e4d4d53967547cda84e5ebd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant: admin Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant-Name: admin Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User: admin Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Domain-Id: default Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Domain-Name: Default Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Id: 4fff265355db498da98d8cb52b62f573 Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Name: admin Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: method: > Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: exception: Flavor 42 could not be found. Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: action_args: {'id': '42'} Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:23:15.688452 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:15.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.693147 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-9dcc17ee-347e-469a-88f0-e3a260e272fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:23:15.695161 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-9dcc17ee-347e-469a-88f0-e3a260e272fb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.543140 Oct 04 14:23:15.695161 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 20/39] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Oct 4 14:23:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 544 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:15.697903 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-b50f2020-39f5-4e53-b3b1-6c5d647f07a7 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:15.702218 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:23:15.723603 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-b50f2020-39f5-4e53-b3b1-6c5d647f07a7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029250 Oct 04 14:23:15.724256 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 20/40] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Oct 4 14:23:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:23:15.735579 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-3cc266db-4cd2-430f-b286-f31ec61afe00 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:15.760568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-3cc266db-4cd2-430f-b286-f31ec61afe00 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029489 Oct 04 14:23:15.761156 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 21/41] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Oct 4 14:23:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:23:15.772989 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-f6bed310-8c90-4dd5-b32c-fdcc50f2e09c admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:15.779351 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.wsgi [None req-f6bed310-8c90-4dd5-b32c-fdcc50f2e09c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-f6bed310-8c90-4dd5-b32c-fdcc50f2e09c admin admin] Request method failure captured: Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Accept: application/json Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Accept-Encoding: gzip, deflate Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Connection: keep-alive Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Content-Length: 0 Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Host: 10.222.0.64 Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Openstack-Api-Version: compute 2.92 Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Openstack-System-Scope: None Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: User-Agent: python-novaclient Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Auth-Token: gAAAAABjPEHShOd36Rik_FK8KczQBDsuFrIV9NvAigtL5F0IfuWykS_-vGT5Cj0EA-vTEgnpmeP4sREAvsT1hE_2WZmqUOUzXMP1dt80eY1Dk_u2ssLmLHxg6KBT69Xg9eY8fdzBbTioaTzGSAw6oUk-KH3JFJvPQK4Sh4ji0VZKEq5Smr_beWs Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Domain-Id: None Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Domain-Name: None Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Identity-Status: Confirmed Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Is-Admin-Project: True Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Domain-Id: default Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Domain-Name: Default Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Name: admin Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Role: reader,member,admin Oct 04 14:23:15.783705 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Roles: reader,member,admin Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79763f634e4d4d53967547cda84e5ebd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant: admin Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant-Name: admin Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User: admin Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Domain-Id: default Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Domain-Name: Default Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Id: 4fff265355db498da98d8cb52b62f573 Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Name: admin Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: method: > Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: exception: Flavor 42 could not be found. Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: action_args: {'id': '42'} Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:23:15.786209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:15.787632 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:15.789979 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-f6bed310-8c90-4dd5-b32c-fdcc50f2e09c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:23:15.791921 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-f6bed310-8c90-4dd5-b32c-fdcc50f2e09c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.017812 Oct 04 14:23:15.791921 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Oct 4 14:23:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 14:23:17.163480 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-3cc266db-4cd2-430f-b286-f31ec61afe00 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:17.164555 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-3cc266db-4cd2-430f-b286-f31ec61afe00 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 04 14:23:17.164976 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 22/43] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:17.843637 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-7e0c33fa-d373-43ce-ae5d-336e428586e2 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:17.850817 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.wsgi [None req-7e0c33fa-d373-43ce-ae5d-336e428586e2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-7e0c33fa-d373-43ce-ae5d-336e428586e2 admin admin] Request method failure captured: Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Accept: application/json Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Accept-Encoding: gzip, deflate Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Connection: keep-alive Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Content-Length: 0 Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Host: 10.222.0.64 Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Openstack-Api-Version: compute 2.92 Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Openstack-System-Scope: None Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: User-Agent: python-novaclient Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Auth-Token: gAAAAABjPEHVV7zwA24mfsn-DxOTpGdVxcXYBZCp1sNM3TIWv6vWsNEf4ukvcCHSHbbxQAVB6RMLJoPgP8N6QvwjHap9Ot5Of0X3ED-C4Ht1mOyE6jfhMbaHhcF-RhtQOhJ5QljW4GfTRmi2OtblkIGfrA3CZ3a4UpI4-OaQtsQo-i5WKu1qshU Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Domain-Id: None Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Domain-Name: None Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Identity-Status: Confirmed Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Is-Admin-Project: True Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Domain-Id: default Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Domain-Name: Default Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Name: admin Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Role: reader,member,admin Oct 04 14:23:17.852462 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Roles: reader,member,admin Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79763f634e4d4d53967547cda84e5ebd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant: admin Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant-Name: admin Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User: admin Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Domain-Id: default Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Domain-Name: Default Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Id: 4fff265355db498da98d8cb52b62f573 Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Name: admin Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: method: > Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: exception: Flavor 84 could not be found. Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: action_args: {'id': '84'} Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:23:17.853976 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:17.856445 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.857620 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-7e0c33fa-d373-43ce-ae5d-336e428586e2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:23:17.858931 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-7e0c33fa-d373-43ce-ae5d-336e428586e2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.548669 Oct 04 14:23:17.858931 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Oct 4 14:23:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 550 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:17.868913 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-b7e782c8-1a07-4035-b2c2-f1d1e0761c70 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:17.887772 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-b7e782c8-1a07-4035-b2c2-f1d1e0761c70 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023924 Oct 04 14:23:17.888397 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Oct 4 14:23:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:23:17.906607 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-1330d5b4-86cd-4571-8fba-b90decf82c16 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:17.936679 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-1330d5b4-86cd-4571-8fba-b90decf82c16 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.036622 Oct 04 14:23:17.937546 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Oct 4 14:23:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:23:17.958462 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-ac8f07ff-f7fa-4fb8-bc1e-c62ebfc7702d admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:17.966621 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.wsgi [None req-ac8f07ff-f7fa-4fb8-bc1e-c62ebfc7702d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-ac8f07ff-f7fa-4fb8-bc1e-c62ebfc7702d admin admin] Request method failure captured: Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Accept: application/json Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Accept-Encoding: gzip, deflate Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Connection: keep-alive Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Content-Length: 0 Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Host: 10.222.0.64 Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Openstack-Api-Version: compute 2.92 Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Openstack-System-Scope: None Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: User-Agent: python-novaclient Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Auth-Token: gAAAAABjPEHVV7zwA24mfsn-DxOTpGdVxcXYBZCp1sNM3TIWv6vWsNEf4ukvcCHSHbbxQAVB6RMLJoPgP8N6QvwjHap9Ot5Of0X3ED-C4Ht1mOyE6jfhMbaHhcF-RhtQOhJ5QljW4GfTRmi2OtblkIGfrA3CZ3a4UpI4-OaQtsQo-i5WKu1qshU Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Domain-Id: None Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Domain-Name: None Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Identity-Status: Confirmed Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Is-Admin-Project: True Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Domain-Id: default Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Domain-Name: Default Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Name: admin Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Role: reader,member,admin Oct 04 14:23:17.969347 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Roles: reader,member,admin Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79763f634e4d4d53967547cda84e5ebd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant: admin Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant-Name: admin Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User: admin Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Domain-Id: default Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Domain-Name: Default Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Id: 4fff265355db498da98d8cb52b62f573 Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Name: admin Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: method: > Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: exception: Flavor 84 could not be found. Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: action_args: {'id': '84'} Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:23:17.972574 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:17.975133 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:17.976238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-ac8f07ff-f7fa-4fb8-bc1e-c62ebfc7702d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:23:17.977436 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-ac8f07ff-f7fa-4fb8-bc1e-c62ebfc7702d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.020415 Oct 04 14:23:17.977436 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 24/47] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Oct 4 14:23:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:19.453773 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-1330d5b4-86cd-4571-8fba-b90decf82c16 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:19.456220 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-1330d5b4-86cd-4571-8fba-b90decf82c16 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002814 Oct 04 14:23:19.456628 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 24/48] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:20.227027 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-624d3dfb-adb5-46e6-9f7c-3ea23b203b25 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:20.233972 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.wsgi [None req-624d3dfb-adb5-46e6-9f7c-3ea23b203b25 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-624d3dfb-adb5-46e6-9f7c-3ea23b203b25 admin admin] Request method failure captured: Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Accept: application/json Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Accept-Encoding: gzip, deflate Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Connection: keep-alive Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Content-Length: 0 Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Host: 10.222.0.64 Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Openstack-Api-Version: compute 2.92 Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Openstack-System-Scope: None Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: User-Agent: python-novaclient Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Auth-Token: gAAAAABjPEHX726X4IGCW92ZztQfvPo90cENwsYdilkcaTF4vLtj36F6DpZ_kkBXwpCExFT_FDbjU-lHQVRX2kiIxQsykHj48Z300erTDdMVOVi9Y8A8ZREGKoHTO59RfruycSqAVNgyayoEVRkGWTju4CVb1OyOoRhio0sXIDeFzdj4mmMLZRk Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Domain-Id: None Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Domain-Name: None Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Identity-Status: Confirmed Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Is-Admin-Project: True Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Domain-Id: default Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Domain-Name: Default Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Project-Name: admin Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Role: reader,member,admin Oct 04 14:23:20.235568 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Roles: reader,member,admin Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79763f634e4d4d53967547cda84e5ebd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant: admin Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-Tenant-Name: admin Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User: admin Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Domain-Id: default Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Domain-Name: Default Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Id: 4fff265355db498da98d8cb52b62f573 Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: X-User-Name: admin Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: method: > Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: exception: Flavor 451 could not be found. Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: action_args: {'id': '451'} Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:23:20.239019 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:20.240694 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.243048 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-624d3dfb-adb5-46e6-9f7c-3ea23b203b25 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:23:20.245194 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-624d3dfb-adb5-46e6-9f7c-3ea23b203b25 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.631656 Oct 04 14:23:20.245194 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 25/49] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Oct 4 14:23:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 636 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 14:23:20.250783 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-aa504a1b-5805-47b5-a540-7db77c14f1ab admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:20.268754 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-aa504a1b-5805-47b5-a540-7db77c14f1ab admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022064 Oct 04 14:23:20.269353 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 25/50] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Oct 4 14:23:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:23:20.279830 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:20.296116 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019960 Oct 04 14:23:20.296798 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 26/51] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Oct 4 14:23:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:23:20.308234 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-b41eb14e-e7e9-48e0-b3f2-39bb2db980a1 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:20.315618 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.wsgi [None req-b41eb14e-e7e9-48e0-b3f2-39bb2db980a1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-b41eb14e-e7e9-48e0-b3f2-39bb2db980a1 admin admin] Request method failure captured: Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Accept: application/json Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Accept-Encoding: gzip, deflate Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Connection: keep-alive Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Content-Length: 0 Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Host: 10.222.0.64 Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Openstack-Api-Version: compute 2.92 Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Openstack-System-Scope: None Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: User-Agent: python-novaclient Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Auth-Token: gAAAAABjPEHX726X4IGCW92ZztQfvPo90cENwsYdilkcaTF4vLtj36F6DpZ_kkBXwpCExFT_FDbjU-lHQVRX2kiIxQsykHj48Z300erTDdMVOVi9Y8A8ZREGKoHTO59RfruycSqAVNgyayoEVRkGWTju4CVb1OyOoRhio0sXIDeFzdj4mmMLZRk Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Domain-Id: None Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Domain-Name: None Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Identity-Status: Confirmed Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Is-Admin-Project: True Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Domain-Id: default Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Domain-Name: Default Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Project-Name: admin Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Role: reader,member,admin Oct 04 14:23:20.317443 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Roles: reader,member,admin Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79763f634e4d4d53967547cda84e5ebd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79763f634e4d4d53967547cda84e5ebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant: admin Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant-Id: 79763f634e4d4d53967547cda84e5ebd Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-Tenant-Name: admin Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User: admin Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Domain-Id: default Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Domain-Name: Default Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Id: 4fff265355db498da98d8cb52b62f573 Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: X-User-Name: admin Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: method: > Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: exception: Flavor 451 could not be found. Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: action_args: {'id': '451'} Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:23:20.320350 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:20.322003 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: ERROR nova.api.openstack.wsgi Oct 04 14:23:20.324455 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-b41eb14e-e7e9-48e0-b3f2-39bb2db980a1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:23:20.326749 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-b41eb14e-e7e9-48e0-b3f2-39bb2db980a1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.015493 Oct 04 14:23:20.326749 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 26/52] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Oct 4 14:23:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 14:23:21.673993 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:21.675238 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Oct 04 14:23:21.675792 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:22.483349 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-632ec195-2a55-4846-94bc-6365ad8e667f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:23:22.507525 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-632ec195-2a55-4846-94bc-6365ad8e667f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.686820 Oct 04 14:23:22.508351 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 27/54] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Oct 4 14:23:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:23:23.973726 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:23.974884 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 04 14:23:23.975430 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:24.690582 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-70c62fd1-8280-4c70-a64a-756b56bc611d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:23:24.711303 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-70c62fd1-8280-4c70-a64a-756b56bc611d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.584051 Oct 04 14:23:24.711861 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 28/56] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Oct 4 14:23:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:23:26.080817 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:26.081905 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001867 Oct 04 14:23:26.082343 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 29/57] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:26.694247 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-8b4f3759-822a-45c1-8b8d-d067f4d43c89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:23:26.716209 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-8b4f3759-822a-45c1-8b8d-d067f4d43c89 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.488446 Oct 04 14:23:26.716823 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 29/58] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Oct 4 14:23:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:23:28.119302 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:28.120401 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 04 14:23:28.120734 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 30/59] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:28.781998 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-f4e5a784-762a-4650-bb70-af11a15a41be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:23:28.804519 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-f4e5a784-762a-4650-bb70-af11a15a41be admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.539006 Oct 04 14:23:28.805178 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 30/60] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Oct 4 14:23:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:23:30.133388 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:30.134407 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 04 14:23:30.134812 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 31/61] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:23:30.736660 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-cd00dde6-609a-46e4-8d2a-2979b7fb8faf admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:23:30.758366 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-cd00dde6-609a-46e4-8d2a-2979b7fb8faf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.476771 Oct 04 14:23:30.758916 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 31/62] 10.222.0.64 () {60 vars in 1202 bytes} [Tue Oct 4 14:23:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:24:30.992879 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:24:30.993818 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-434f0329-b77e-4c9b-b38c-58ce95078af2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 04 14:24:30.994222 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 32/63] 10.222.0.64 () {54 vars in 931 bytes} [Tue Oct 4 14:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:24:31.002557 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:31.481972 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-d35eecfa-c3a8-4e00-bf64-84c5dd99229b admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:24:31.504205 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-d35eecfa-c3a8-4e00-bf64-84c5dd99229b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.503685 Oct 04 14:24:31.504859 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 32/64] 10.222.0.64 () {60 vars in 1292 bytes} [Tue Oct 4 14:24:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:24:31.527577 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_api:SELECT=14 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:24:31.531448 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-4f9eca79-ed88-46ea-a53a-31907300c8a8 admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:24:31.540374 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-4f9eca79-ed88-46ea-a53a-31907300c8a8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014097 Oct 04 14:24:31.540988 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 33/65] 10.222.0.64 () {60 vars in 1283 bytes} [Tue Oct 4 14:24:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:24:31.553783 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-f3740ae6-8359-42aa-9da7-59fd163771d7 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:24:31.561713 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-f3740ae6-8359-42aa-9da7-59fd163771d7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011480 Oct 04 14:24:31.562205 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 33/66] 10.222.0.64 () {60 vars in 1286 bytes} [Tue Oct 4 14:24:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:24:31.574898 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:24:31.583547 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012299 Oct 04 14:24:31.584108 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 34/67] 10.222.0.64 () {60 vars in 1286 bytes} [Tue Oct 4 14:24:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:24:31.597085 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-61e7fd89-92af-4551-b741-2f1ef91011c5 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:24:31.604962 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-61e7fd89-92af-4551-b741-2f1ef91011c5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012409 Oct 04 14:24:31.605532 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 34/68] 10.222.0.64 () {60 vars in 1283 bytes} [Tue Oct 4 14:24:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:27:32.649842 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:32.650916 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 04 14:27:32.651351 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 35/69] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:27:32.799534 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_api:SELECT=6 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:32.967035 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:32.972198 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:32.972720 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:32.973156 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:32.973888 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:32.974344 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:32.974768 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:33.013414 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-7e2d9e74-9c03-43a9-8091-6fe4e2e067f0 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.215050 Oct 04 14:27:33.013987 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 35/70] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Oct 4 14:27:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 14:27:34.178150 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:34.179170 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 04 14:27:34.179569 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:27:34.382894 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:34.386518 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:34.387017 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:34.387452 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:34.388194 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:34.388685 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:34.389118 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:34.409450 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-79d6bcfb-78fc-4f50-a8a2-d9b0e8fb7738 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083260 Oct 04 14:27:34.410038 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 36/72] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Oct 4 14:27:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:27:46.208834 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:46.209885 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 04 14:27:46.210301 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:27:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:27:46.378695 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_cell0:SELECT=4 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:46.380417 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_cell1:SELECT=4 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:46.381103 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG dbcounter [-] [105572] Writing DB stats nova_api:SELECT=8 {{(pid=105572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:27:46.449371 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:46.453257 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:46.453967 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:46.454243 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:46.456655 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:46.456655 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:46.456655 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:46.485426 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-34f34dd3-4c6b-469c-b9a6-d763de6596ab admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.112199 Oct 04 14:27:46.486275 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 37/74] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Oct 4 14:27:46 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:27:47.749309 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG nova.api.openstack.wsgi [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] Calling method '>' {{(pid=105571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:47.750335 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: INFO nova.api.openstack.requestlog [None req-41471785-f51c-4a81-b518-7534203eec7d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 04 14:27:47.750756 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: [pid: 105571|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Oct 4 14:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:27:47.963349 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG nova.api.openstack.wsgi [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Calling method '>' {{(pid=105572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:27:47.967812 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:47.968301 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:47.968764 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:47.969496 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:27:47.969951 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:27:47.970372 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: DEBUG oslo_concurrency.lockutils [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:27:47.993531 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: INFO nova.api.openstack.requestlog [None req-9294e4ec-e58c-4c12-a0c5-8e3e4787a896 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.089676 Oct 04 14:27:47.994112 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: [pid: 105572|app: 0|req: 38/76] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Oct 4 14:27:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:28:45.205538 dv-cinder-860260-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 14:28:45.206402 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: Tue Oct 4 14:28:45 2022 - graceful shutdown triggered... Oct 04 14:28:45.206873 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: Gracefully killing worker 1 (pid: 105571)... Oct 04 14:28:45.207234 dv-cinder-860260-1-iscsi devstack@n-api.service[105572]: Gracefully killing worker 2 (pid: 105572)... Oct 04 14:28:45.336137 dv-cinder-860260-1-iscsi devstack@n-api.service[105571]: DEBUG dbcounter [-] [105571] Writing DB stats nova_api:SELECT=4 {{(pid=105571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:28:46.206924 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: worker 1 buried after 1 seconds Oct 04 14:28:46.206924 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: worker 2 buried after 1 seconds Oct 04 14:28:46.206924 dv-cinder-860260-1-iscsi devstack@n-api.service[105570]: goodbye to uWSGI. Oct 04 14:28:46.208571 dv-cinder-860260-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 14:28:46.209370 dv-cinder-860260-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 14:28:46.213323 dv-cinder-860260-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 14:28:46.230178 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 14:28:46 2022] *** Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: nodename: dv-cinder-860260-1-iscsi Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: machine: x86_64 Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: clock source: unix Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: pcre jit disabled Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: detected number of CPU cores: 4 Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: current working directory: / Oct 04 14:28:46.232497 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: detected binary path: /usr/bin/uwsgi-core Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: your processes number limit is 47680 Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: your memory page size is 4096 bytes Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: detected max file descriptor number: 2048 Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: lock engine: pthread robust mutexes Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: thunder lock: enabled Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 14:28:46.233297 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 14:28:46.273807 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: Python main interpreter initialized at 0x5651509759c0 Oct 04 14:28:46.273807 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: python threads support enabled Oct 04 14:28:46.273807 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: your server socket listen backlog is limited to 100 connections Oct 04 14:28:46.273807 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: your mercy for graceful operations on workers is 90 seconds Oct 04 14:28:46.274300 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 14:28:46.274300 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: *** Operational MODE: preforking *** Oct 04 14:28:46.274594 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: *** uWSGI is running in multiple interpreter mode *** Oct 04 14:28:46.274594 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: spawned uWSGI master process (pid: 120809) Oct 04 14:28:46.278905 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: spawned uWSGI worker 1 (pid: 120820, cores: 1) Oct 04 14:28:46.278905 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: spawned uWSGI worker 2 (pid: 120821, cores: 1) Oct 04 14:28:46.278905 dv-cinder-860260-1-iscsi devstack@n-api.service[120809]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 14:28:46.275833 dv-cinder-860260-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 14:28:47.044004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 14:28:47.080587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 14:28:48.261946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:28:48.261946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: from cryptography.utils import int_from_bytes Oct 04 14:28:48.262561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:28:48.262561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: from cryptography.utils import int_from_bytes Oct 04 14:28:48.398675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:28:48.398675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: from cryptography.utils import int_from_bytes Oct 04 14:28:48.400223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 14:28:48.400223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: from cryptography.utils import int_from_bytes Oct 04 14:28:50.976760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 14:28:50.977630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 14:28:50.978228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 14:28:50.978820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 14:28:50.979252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 14:28:50.979921 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.980681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.981072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.981623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.982226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.982781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.983278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.983819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.984301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.984732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.985214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.985894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860260-1-iscsi {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.986377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.986845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.987306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.987787 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.988274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.988799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.989297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.990168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.992815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.992815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.992815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.993344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.993494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.994951 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.994951 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.995307 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.995778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.996845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.997030 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860260-1-iscsi {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.997454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.998028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.998599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.999308 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:50.999771 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.000371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.000993 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.001466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.001931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.002410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.002888 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.003365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.003690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 14:28:51.004574 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.004848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 14:28:51.005105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.005365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 14:28:51.005365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 14:28:51.005853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.006092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 14:28:51.006092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.006575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.006825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.006825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.007321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.007614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.007873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.008153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.008153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.008805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.009631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.009631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.011033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.011295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.011295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.011800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.012052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.012052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860260-1-iscsi {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.012555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.012813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.012813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.014085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.014329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.014329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.014817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.015722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.016036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.016290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.016290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.016805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.017079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.017379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.017631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.017631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.018102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.018415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.018704 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.018959 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.018959 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.019425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.019680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.019680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.020168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.020521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.020521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.020990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.021229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.021229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860260-1-iscsi {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.021718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.021969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.022206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.022445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.022445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.022953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.023220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.023220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.024511 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.025423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.025423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.026541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.026802 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.027041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.027284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.027284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.028759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.029027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.029027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.029508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.029963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.029963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.030474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.030731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.030731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.031214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.031471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.031721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.031983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.031983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.031983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.035142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.035415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.035415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.036607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.036862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.037125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.037369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.037369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.037369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.038103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.038356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.038356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.038930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.039184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.039184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.039675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.039942 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.040269 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.040580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.040580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.041072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.041322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.041322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.041816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.042053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.042053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.042528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.042779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.042779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.043241 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.043481 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.043740 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.043993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.044726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.045300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.045300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.045300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.046045 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.046908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.047158 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.047408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.047408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.047883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.048246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.048246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.049006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.049290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.049290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.050597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.050871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.050871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.051329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.051570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.051820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.052085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.052085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.052929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.053183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.053183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.053670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.053929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.053929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.054430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.055129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.055129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.055954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.057100 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.057100 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.058192 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.058451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.058451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.059008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.059264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.059264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.060226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.060542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.060542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.061032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.061274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.061274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.061757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.061998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.062239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.062510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.062510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.063006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.063246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.063246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.063741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.064001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.064001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.064510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.064798 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.065532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.066131 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.066131 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.066614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.066852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.066852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.067321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.068271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.068271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.068793 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.069102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.069102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.069570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.069831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.069831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.070297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.070561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.070561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.071025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.071278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.071278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.072286 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.072578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.072578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.073048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.073311 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.073311 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.073779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.074032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.074032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.074516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.074769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.074769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.075702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.075984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.075984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.076824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.077091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.077091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.077563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.078128 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.078780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.079124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.079124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.079606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.079873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.079873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.080397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.080656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.080656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.081111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.081367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.081618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.081855 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.081855 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.082330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.082579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.082579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.083067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.083319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.083319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.083795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.084047 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.084286 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.084566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.084566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.085040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.085277 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.085277 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.086176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.086607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.086607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.087763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.087939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.087939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.088532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.089002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.089255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.089410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.089410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.089696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.089869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.089869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.090164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.090322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.090322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.090639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 14:28:51.090799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.090799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.091089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.091259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.091259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.091551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.091711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.091711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.092983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093145 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093145 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093438 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093910 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.093910 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.094183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.094331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.094331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.094601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.094874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.094874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.095159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.095318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.095318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.095687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.095877 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.095877 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.096593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.096748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.096748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.097313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.097472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.097472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.097758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.097931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.097931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.098265 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.098656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.098656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.099305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.099479 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.099629 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.099795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.099795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.100099 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.100247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.100247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.100585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.100754 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.100754 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.101059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.101202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.101202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.101494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.110168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.110168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.110501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.110733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.110733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.111199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.111370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.111528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.111774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.111774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112576 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.112994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.113143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.113143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.113429 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.113735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.113735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.114356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.114526 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.114526 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.114824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.114975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.114975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.115270 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.115422 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.115604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.115786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.115786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.115786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.116440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.116591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.116745 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.116898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.116898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.117194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.117348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.117348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.117651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.117801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.117801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.118091 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.118234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.118234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.119758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.120551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.120551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.120867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.121897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.122184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.122329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.122329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.122636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.122800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.122800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123053 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.123893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.124850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.125170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.125331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.125331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.125593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.125747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.125912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.126900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.127952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.128234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.128471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.128471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.128471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.128934 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.129078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.129078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.130846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.131597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.132916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.133195 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.133347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.133523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.133662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.133662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.133662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.134828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.135795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.136221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.136405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.136405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.136691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.136850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137882 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.137882 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.138179 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.138322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.138481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.138635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.138794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.138928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.139056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.139185 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.139312 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.139448 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.141659 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.141819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.141978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.142136 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.142292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.142436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.142600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.142743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.142893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143658 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.143952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.144096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.144257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.144257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.144564 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.144738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.144881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145640 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.145926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146083 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146372 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.146953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.147230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.147375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.147375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.147652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.147788 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.147927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.148984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.149291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.149438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.149438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.149746 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.151731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.151731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152083 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152894 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152894 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.152894 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.153321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.153477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.153477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.154972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155127 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.155740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156656 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.156819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157219 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.157829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.158501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.158661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.158661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.158938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159514 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159677 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159677 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.159963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.160116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.160116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.160116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.162870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.163175 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.163361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.163361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.163361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.163812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.163967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.164118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.164268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.164268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.164601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.164738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.164884 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.165035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166110 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166767 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.166915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.167328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.167473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.167473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.167473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.167865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.168511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.169801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.170209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.170367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.170367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.170679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.171310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.171310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.172801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.173703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.173847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.173986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.174998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.175150 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.175150 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.175441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.175597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.175597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.176760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.176919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.176919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.176919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.177340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.177510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.177510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.177510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.177918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.178792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.179551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.179727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.179727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.180759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.183204 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.183377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.183377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.183377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.183377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.183899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.184055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.184334 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.184504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.184661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.184824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.184999 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185319 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185745 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.185895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.186343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.186495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.186495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.186762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.186925 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187624 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.187782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188865 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.188865 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189280 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189280 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189280 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.189852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.190874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.191176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.191335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.191490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.191645 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.192489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.193185 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.193380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.193538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.193680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.193833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.193833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.194721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.195174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.195337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.195337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.195337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.195828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.196661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197189 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.197774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.198162 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.198300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.198300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.198857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.199878 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.200023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.200177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.200177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.200639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.200811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.201193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.201353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.201493 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.201660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.201660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.201660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.202286 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.202470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.202470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.202470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.202950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.203370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.203370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.203679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.203837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.203837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.203837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.204287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.204461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.204638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.204797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.204973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.205786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.206757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.206928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.206928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.206928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.206928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.207505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.207679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.207679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.207967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.208986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.209612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.209757 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.209757 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.209757 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210325 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210325 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210584 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.210724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.211966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.214317 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.214464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.214464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.214464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.214854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.215939 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.216144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.216144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.216448 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.216612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.216612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.216920 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.217089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.217089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.217400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.217569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.217569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.217569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.218945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.219277 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.219435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.219435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.219435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.219435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.220953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.221673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.221842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.221842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.222160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.222331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.222331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.222630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.222797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.222797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.223090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.223249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.223249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.223552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.223712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.223876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.224015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.224173 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.224587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.224587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.224918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.225235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226951 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.226951 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.227244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.227395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.227395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.227694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.228536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.228705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.228852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.228852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.229112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.229349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.229349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.229780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.229914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.229914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230166 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230674 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230674 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.230917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.231914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232590 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232878 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.232878 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233320 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233320 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.233992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.234121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.234121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.234398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.234552 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.234552 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.237186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.237358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.237358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.237669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.237858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238514 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.238686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.239262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.239423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.239423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.239423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.239917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.240087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.240246 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.240428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.240428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.240741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.240909 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.241077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.241246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.241443 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.241614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.241614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.241936 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242391 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.242551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.245467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.245615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.245756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.245971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.245971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.246310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.246480 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.246654 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.246838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.246838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.246838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.247291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.247452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.247452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.247757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.247917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.247917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.248253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.248699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.248699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.249010 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.249170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.249170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.249542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.249716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.249716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.250957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.251967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.252284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.252496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.252496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.252796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.252968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.252968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.253272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.253429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.253429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.253718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.253887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.253887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.254176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.254344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.254499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255754 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.255909 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.256069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.256226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.256433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.256592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.256592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.256919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.257088 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.257088 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.258340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.258515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.258685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.258863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.258863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.259750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.259921 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.259921 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.260225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.260706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.260706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261174 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261174 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.261966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.262416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.262575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.262744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.262910 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.262910 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.263190 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.263363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.263363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.263653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.263794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.263794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.264106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.264264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.264264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.264602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.264756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.264756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265075 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265534 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.265979 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.266122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.266122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.266401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.266554 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.266554 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.266859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267802 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.267802 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268071 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268687 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268840 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.268981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.269250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.269414 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.269414 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.269677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.270768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.270768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.271086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.271258 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.271258 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.271554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.271714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.271714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.272025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.272182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.272367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.272527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.272527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.273915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.274063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.274063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.274345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.274485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.274485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.274817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.275987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276332 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276332 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.276714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.277232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.277371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.277371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.277643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.277787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.277787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.278857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.279825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280211 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280211 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.280774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.281785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.282756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.283989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.283989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.283989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.284734 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.284734 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.285006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.285142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.285530 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.285759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.286072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.286396 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.286741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.287083 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.287360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.287682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.288005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.288355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.288678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.288991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.289317 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.289652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.290098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.290614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.290943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.291278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.291620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.291937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.292251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.292602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.292916 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.293232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.293566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.293881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.294202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.294521 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.294840 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.295153 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.295465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.295802 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.296135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.296466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.296792 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.297410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.297668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.297910 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.298156 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.298377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.298670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.298983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.299293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.299647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.299957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.300287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.300704 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.301041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.301361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.301705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.302041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.302368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.302684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.303008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.303341 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.303653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.303991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.304281 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.304620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.304932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.305244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.305558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.306403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.306718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.307028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.307486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.307789 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.308127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.308470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.308783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.309096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.309407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.309762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.310215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.310410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.310731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.311065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.311392 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.311750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.312045 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.312392 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.312719 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.313041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.313362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.313678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.314004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.314325 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.314676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.315251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.315590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.315912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.316230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.316577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.316897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.317216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.317668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.317829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.318147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.318492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.318818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.319152 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.319489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.319834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.320163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.320517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.320841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.321161 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.322143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.322558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.323129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.323505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.323841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.324167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.324522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.324845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.325171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.325493 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.325814 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.326132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.326455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.326778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.327116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.327467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.327838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.328118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.328468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.328795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.329393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.329718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.330065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.330401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.330735 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.331064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.331403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.331737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.332054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.332398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.332727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.333048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.333377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.333702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.334022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.334335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.334666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.334986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.335592 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.335951 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.336279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.336638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.336973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.337554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.338198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.338341 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.338668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.339028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.339304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.339625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.339941 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.340255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.340636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.340956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.341267 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.341590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.341904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.342241 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.342557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.342871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.343181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.343500 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.343812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.344130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.344467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.344783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.345106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.345419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.345848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.346162 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.346484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.346856 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.347174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.347485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.347828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.348141 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.348509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.348846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.349164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.349520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.349828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.350152 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.350518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.350842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.351461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.351809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.352143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.352531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.353001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.353322 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.353637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.353952 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.354292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.354722 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.355046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.355361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.355680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.355994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.356331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.356657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.356977 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.357294 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.357606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.357922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.358238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.358603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.358872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.359199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.359560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.360023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.360183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.360533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.360861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.361180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.361503 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.361821 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.362136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.362459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.362805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.363140 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.363454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.363902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.364223 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.364576 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.364906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.365225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.365558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.365889 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.366206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.366533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.366848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.367188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.367535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.367871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.368200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.369674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.369674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.369988 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.370270 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.370697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.370910 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.371226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.371547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.371862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.372176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.372532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.372849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.373158 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.373475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.373781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.374093 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.374402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.374721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.375024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.375345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.375661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.375971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.376283 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.376621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.376931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.377243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.377596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.377933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.378255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.378579 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.378898 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.379657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.379657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.380064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.380280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.380541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.381138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.381138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.381539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.381780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.382115 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.382400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.382716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.383033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.383445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.384672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.384672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.385133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.385370 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.385712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.385989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.386177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.386519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.386832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.387150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.387481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.387782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.388095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.388461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.388779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.389096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.389443 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.389742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.390086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.390413 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.390730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.391063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.391403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.391769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.392089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.392468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.392806 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.393127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.393445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.393766 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 14:28:51.394028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 14:28:51.436015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO dbcounter [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Registered counter for database nova_api Oct 04 14:28:51.457778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.458533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO dbcounter [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Registered counter for database nova_api Oct 04 14:28:51.465872 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writer thread running {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.480815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_db.sqlalchemy.engines [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.488203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writer thread running {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.528584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.context [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d0b2b96-fdc7-4407-8ca1-86c8c8070a51(cell1) {{(pid=120820) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 14:28:51.532443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:28:51.532922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:28:51.534788 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:28:51.535562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:28:51.536001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:28:51.538045 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:28:51.540108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO dbcounter [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Registered counter for database nova_cell0 Oct 04 14:28:51.544669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO dbcounter [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Registered counter for database nova_cell1 Oct 04 14:28:51.547851 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.context [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8d0b2b96-fdc7-4407-8ca1-86c8c8070a51(cell1) {{(pid=120821) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 14:28:51.552165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:28:51.552463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.552696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:28:51.554401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:28:51.554589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.555195 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:28:51.555661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:28:51.558605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:28:51.560651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writer thread running {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.560780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO dbcounter [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Registered counter for database nova_cell0 Oct 04 14:28:51.562950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writer thread running {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.565080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO dbcounter [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Registered counter for database nova_cell1 Oct 04 14:28:51.573818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_db.sqlalchemy.engines [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.575320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_db.sqlalchemy.engines [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.584508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writer thread running {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.585827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writer thread running {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.714959 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO dbcounter [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Registered counter for database nova_cell0 Oct 04 14:28:51.722477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_db.sqlalchemy.engines [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.728419 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writer thread running {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:51.744713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO dbcounter [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Registered counter for database nova_cell0 Oct 04 14:28:51.756266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_db.sqlalchemy.engines [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 14:28:51.763016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writer thread running {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 14:28:52.074408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: WARNING keystonemiddleware.auth_token [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:28:52.082560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: WARNING keystonemiddleware.auth_token [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:28:52.159377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: WARNING keystonemiddleware.auth_token [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:28:52.167796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: WARNING keystonemiddleware.auth_token [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:28:52.524231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: WARNING keystonemiddleware.auth_token [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:28:52.531534 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: WARNING keystonemiddleware.auth_token [None req-bf4d26c6-ed4f-49dd-ae08-028351fd7137 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:28:52.537352 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651509759c0 pid: 120820 (default app) Oct 04 14:28:52.589416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: WARNING keystonemiddleware.auth_token [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 14:28:52.595824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: WARNING keystonemiddleware.auth_token [None req-1ef05fea-cf10-4613-a8be-de30a365792b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 14:28:52.601395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651509759c0 pid: 120821 (default app) Oct 04 14:29:30.474326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.475336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.476160 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.477512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.950684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.952062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.953616 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:30.954716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:29:32.109344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-361c40c3-938d-4bac-b96e-7d098ee5ce37 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Action: 'create', calling method: .version_select at 0x7f57196734c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1759261044"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:33.311287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-295abaee-f07a-4ebc-a468-c178c4816a45 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Action: 'create', calling method: .version_select at 0x7f57196c14c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1250562500", "metadata": {"Type": "work"}}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:35.133593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-295abaee-f07a-4ebc-a468-c178c4816a45 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.204555 Oct 04 14:29:35.135062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Oct 4 14:29:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4210 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 14:29:35.152115 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-02592859-f262-4a7c-9d29-ac4ea69071c1 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Calling method '.version_select at 0x7f57195943a0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:35.237829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-361c40c3-938d-4bac-b96e-7d098ee5ce37 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.769130 Oct 04 14:29:35.238656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 1/2] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Oct 4 14:29:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4772 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 14:29:35.258629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d86583c6-e023-40dc-89ca-500ae46c2c0f tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f571954b3a0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:35.366721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-02592859-f262-4a7c-9d29-ac4ea69071c1 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c" status: 200 len: 353 microversion: 2.1 time: 0.219202 Oct 04 14:29:35.377868 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:35 2022] GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c => generated 353 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:35.503655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d86583c6-e023-40dc-89ca-500ae46c2c0f tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae" status: 200 len: 345 microversion: 2.1 time: 0.250640 Oct 04 14:29:35.504242 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:35 2022] GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae => generated 345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:29:36.388149 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2829700d-609a-4698-b876-183607313545 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Calling method '.version_select at 0x7f5719594a60>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:36.489965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2829700d-609a-4698-b876-183607313545 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c" status: 200 len: 354 microversion: 2.1 time: 0.110991 Oct 04 14:29:36.490541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:36 2022] GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:36.506353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-967d8149-690e-4c34-8686-54a2018c20ba tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Calling method '.version_select at 0x7f571954ba60>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:36.524741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-efd3437e-452c-4be4-be03-fdd4c8471c9c tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719531160>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:36.633891 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-967d8149-690e-4c34-8686-54a2018c20ba tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c" status: 200 len: 354 microversion: 2.1 time: 0.132595 Oct 04 14:29:36.634730 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:36 2022] GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:29:36.656843 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-efd3437e-452c-4be4-be03-fdd4c8471c9c tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae" status: 200 len: 346 microversion: 2.1 time: 0.137853 Oct 04 14:29:36.657405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:36 2022] GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:29:36.657862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0b72d1a9-94e5-4579-a7a9-433a8dedb249 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Calling method '.version_select at 0x7f57195651f0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:36.672164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e5f1de97-f88b-4a53-b9a8-d5d425c6f90b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Action: 'create', calling method: .version_select at 0x7f5719594d30>, body: {"snapshot": {"volume_id": "34903f35-844e-465a-92a6-fec52cdb7cae", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1852208807"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:36.817664 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0b72d1a9-94e5-4579-a7a9-433a8dedb249 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c" status: 202 len: 0 microversion: 2.1 time: 0.166267 Oct 04 14:29:36.819180 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:29:36 2022] DELETE /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:29:36.831571 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-407cb06e-6a4d-425f-938e-cd3013d6406f tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Calling method '.version_select at 0x7f571954bb80>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:36.998310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-407cb06e-6a4d-425f-938e-cd3013d6406f tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c" status: 200 len: 353 microversion: 2.1 time: 0.172873 Oct 04 14:29:37.006456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:36 2022] GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:37.462565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e5f1de97-f88b-4a53-b9a8-d5d425c6f90b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.795103 Oct 04 14:29:37.469066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 5/10] 10.222.0.64 () {60 vars in 1162 bytes} [Tue Oct 4 14:29:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:37.475988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b445de5f-3d02-43b7-96ce-e761ad93581d tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f571954b4c0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:37.569331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b445de5f-3d02-43b7-96ce-e761ad93581d tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 200 len: 287 microversion: 2.1 time: 0.097507 Oct 04 14:29:37.570581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:37 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:37.584769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7f900dbd-ff5d-4d0c-82d9-27804e316642 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f57195315e0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:37.685329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7f900dbd-ff5d-4d0c-82d9-27804e316642 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.104535 Oct 04 14:29:37.686135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1140 bytes} [Tue Oct 4 14:29:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:37.702697 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4cca21cb-2c5c-4d1c-bb43-af5c8014ec5f tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f57195653a0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:37.755848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4cca21cb-2c5c-4d1c-bb43-af5c8014ec5f tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 200 len: 287 microversion: 2.1 time: 0.058271 Oct 04 14:29:37.764085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:37 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:38.017345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-10bcb767-5310-4f6a-a8b2-827f4eb724e6 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Calling method '.version_select at 0x7f5719594310>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:38.088250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-10bcb767-5310-4f6a-a8b2-827f4eb724e6 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] HTTP exception thrown: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-10bcb767-5310-4f6a-a8b2-827f4eb724e6 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Request method failure captured: Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c HTTP/1.1 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENKmVVUlCBm65pOUMa5zcoLcnycenwOie0IzJ5j8tt5kD-tx630OWxk7zzE-oy8u2Kq05mamcW9hpw9rECrmXAcjdoPb7tMmZONUTHQ4xSP3gHeLKq8UDaRS_q1zQA4XDUQ5Ujff1RYF4aEgCJfG7MhySql8lUy1KMWf5J3Dz7pra4 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 882ef38f39024b8c88016fb4deacdbe8 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesGetTestJSON-1345837264 Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:29:38.098470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882ef38f39024b8c88016fb4deacdbe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882ef38f39024b8c88016fb4deacdbe8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882ef38f39024b8c88016fb4deacdbe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882ef38f39024b8c88016fb4deacdbe8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesGetTestJSON-1345837264 Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 882ef38f39024b8c88016fb4deacdbe8 Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesGetTestJSON-1345837264 Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesGetTestJSON-1345837264-project Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: f2a6dab7cbbe48239e0e203ce14566ec Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesGetTestJSON-1345837264-project Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '564005f5-45db-40c7-b698-9b1fc6a7859c'} Oct 04 14:29:38.099817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. (HTTP 404) (Request-ID: req-7ebd5ed7-cfb9-4598-935c-24f34bdc9ca3) Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:38.100751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:38.102606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 14:29:38.104609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-10bcb767-5310-4f6a-a8b2-827f4eb724e6 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] Returning 404 to user: Volume 564005f5-45db-40c7-b698-9b1fc6a7859c could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:29:38.105691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-10bcb767-5310-4f6a-a8b2-827f4eb724e6 tempest-VolumesGetTestJSON-1345837264 tempest-VolumesGetTestJSON-1345837264-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c" status: 404 len: 109 microversion: 2.1 time: 0.088437 Oct 04 14:29:38.107822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 7/14] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:38 2022] GET /compute/v2.1/os-volumes/564005f5-45db-40c7-b698-9b1fc6a7859c => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:29:38.777731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bf76e3af-17ee-4417-9825-87a93eca85e9 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f571954b3a0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:38.908662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bf76e3af-17ee-4417-9825-87a93eca85e9 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 200 len: 287 microversion: 2.1 time: 0.139657 Oct 04 14:29:38.910221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:38 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:39.924236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7f99e422-ac34-4748-b777-ac14ec4ab09c tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719ef0940>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:40.160218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7f99e422-ac34-4748-b777-ac14ec4ab09c tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 200 len: 287 microversion: 2.1 time: 0.241015 Oct 04 14:29:40.161038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:39 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 287 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:41.174779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f4903e73-a3f5-4613-a264-86cf20540deb tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f571954baf0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:41.274503 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f4903e73-a3f5-4613-a264-86cf20540deb tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 200 len: 288 microversion: 2.1 time: 0.102873 Oct 04 14:29:41.289256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 9/17] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:41 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:41.290691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1e81712d-b18b-4c87-974f-ded839862112 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f57195941f0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:41.453298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1e81712d-b18b-4c87-974f-ded839862112 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 202 len: 0 microversion: 2.1 time: 0.169208 Oct 04 14:29:41.454275 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1254 bytes} [Tue Oct 4 14:29:41 2022] DELETE /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:29:41.464113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-aa3be253-d3b7-4673-9dd0-034598075c63 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719565040>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:41.553704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-aa3be253-d3b7-4673-9dd0-034598075c63 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 200 len: 287 microversion: 2.1 time: 0.094183 Oct 04 14:29:41.554835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 10/19] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:41 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:42.573520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-99cfa0b1-b4f4-4852-a2d9-f6ccd19b4a97 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719514430>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:42.729697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-99cfa0b1-b4f4-4852-a2d9-f6ccd19b4a97 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] HTTP exception thrown: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-99cfa0b1-b4f4-4852-a2d9-f6ccd19b4a97 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Request method failure captured: Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 HTTP/1.1 Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENK-a0hmoJLG49dZS0qxUuaUzaROgPeRNGjAsYXi92cTddv0C_cIqLcv52ieJvNGcVb5D6pYO4kmvakBm6HI3KPZoTlRwIj8MAJCKCYK0fIJx5xg9jc2TLZ4le9z0dhd4NDH5t_RqxN25KYmlscjj12MTaOtds3MTpyjBrTBX5bdsc Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:29:42.735016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0f752b93233147d59c19b3dc7f5b42c4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: a99a904626e44182a020368a63c4dad3 Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'c2ba8fdb-0541-4482-966b-737c2eae4776'} Oct 04 14:29:42.737211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. (HTTP 404) (Request-ID: req-9d5faf3b-0d3a-4736-b42b-97d4212d5ada) Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.738538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:42.740414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 14:29:42.742296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. Oct 04 14:29:42.744207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:42.770909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-99cfa0b1-b4f4-4852-a2d9-f6ccd19b4a97 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Returning 404 to user: Snapshot c2ba8fdb-0541-4482-966b-737c2eae4776 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:29:42.793844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-99cfa0b1-b4f4-4852-a2d9-f6ccd19b4a97 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776" status: 404 len: 111 microversion: 2.1 time: 0.207839 Oct 04 14:29:42.810362 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-173433d6-463e-4ce7-9fef-e7c78ccba731 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719565a60>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:42.812702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 10/20] 10.222.0.64 () {58 vars in 1251 bytes} [Tue Oct 4 14:29:42 2022] GET /compute/v2.1/os-snapshots/c2ba8fdb-0541-4482-966b-737c2eae4776 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:29:43.015084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-173433d6-463e-4ce7-9fef-e7c78ccba731 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae" status: 202 len: 0 microversion: 2.1 time: 0.211740 Oct 04 14:29:43.044380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:29:42 2022] DELETE /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:29:43.064340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f1f99e59-05fb-45ae-8b98-088153b211a1 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719594ca0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:43.315729 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-f1f99e59-05fb-45ae-8b98-088153b211a1 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] HTTP exception thrown: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f1f99e59-05fb-45ae-8b98-088153b211a1 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Request method failure captured: Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae HTTP/1.1 Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENK-a0hmoJLG49dZS0qxUuaUzaROgPeRNGjAsYXi92cTddv0C_cIqLcv52ieJvNGcVb5D6pYO4kmvakBm6HI3KPZoTlRwIj8MAJCKCYK0fIJx5xg9jc2TLZ4le9z0dhd4NDH5t_RqxN25KYmlscjj12MTaOtds3MTpyjBrTBX5bdsc Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:29:43.320174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0f752b93233147d59c19b3dc7f5b42c4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: a99a904626e44182a020368a63c4dad3 Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '34903f35-844e-465a-92a6-fec52cdb7cae'} Oct 04 14:29:43.322216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. (HTTP 404) (Request-ID: req-e5d7074e-c3c1-4176-a97f-5f548cbf2b29) Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.323497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:43.328164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 14:29:43.329915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.337343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f1f99e59-05fb-45ae-8b98-088153b211a1 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Returning 404 to user: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:29:43.344743 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f1f99e59-05fb-45ae-8b98-088153b211a1 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae" status: 404 len: 109 microversion: 2.1 time: 0.313991 Oct 04 14:29:43.363824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 11/22] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:43 2022] GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae => generated 109 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:29:43.374169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-77575b63-bfa9-41b7-8208-49cfd3307e4b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f571954bdc0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:43.453986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-77575b63-bfa9-41b7-8208-49cfd3307e4b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] HTTP exception thrown: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-77575b63-bfa9-41b7-8208-49cfd3307e4b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Request method failure captured: Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae HTTP/1.1 Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENK-a0hmoJLG49dZS0qxUuaUzaROgPeRNGjAsYXi92cTddv0C_cIqLcv52ieJvNGcVb5D6pYO4kmvakBm6HI3KPZoTlRwIj8MAJCKCYK0fIJx5xg9jc2TLZ4le9z0dhd4NDH5t_RqxN25KYmlscjj12MTaOtds3MTpyjBrTBX5bdsc Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:29:43.471702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0f752b93233147d59c19b3dc7f5b42c4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: a99a904626e44182a020368a63c4dad3 Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '34903f35-844e-465a-92a6-fec52cdb7cae'} Oct 04 14:29:43.473111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. (HTTP 404) (Request-ID: req-8415e851-3731-4a27-9d1c-cc4a9bb4db4d) Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.474087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 14:29:43.475556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 14:29:43.478662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.481594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.491387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-77575b63-bfa9-41b7-8208-49cfd3307e4b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Returning 404 to user: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:29:43.493475 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-77575b63-bfa9-41b7-8208-49cfd3307e4b tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae" status: 404 len: 109 microversion: 2.1 time: 0.126791 Oct 04 14:29:43.504465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-013db6d9-016b-49cd-87b2-6e89deb192c0 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Calling method '.version_select at 0x7f5719594af0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:43.512239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:29:43 2022] DELETE /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:29:43.587750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-013db6d9-016b-49cd-87b2-6e89deb192c0 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] HTTP exception thrown: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-013db6d9-016b-49cd-87b2-6e89deb192c0 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Request method failure captured: Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae HTTP/1.1 Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENK-a0hmoJLG49dZS0qxUuaUzaROgPeRNGjAsYXi92cTddv0C_cIqLcv52ieJvNGcVb5D6pYO4kmvakBm6HI3KPZoTlRwIj8MAJCKCYK0fIJx5xg9jc2TLZ4le9z0dhd4NDH5t_RqxN25KYmlscjj12MTaOtds3MTpyjBrTBX5bdsc Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:29:43.589741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0f752b93233147d59c19b3dc7f5b42c4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0f752b93233147d59c19b3dc7f5b42c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 0f752b93233147d59c19b3dc7f5b42c4 Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-556158222 Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: a99a904626e44182a020368a63c4dad3 Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-556158222-project Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '34903f35-844e-465a-92a6-fec52cdb7cae'} Oct 04 14:29:43.591972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. (HTTP 404) (Request-ID: req-71a66795-a03f-468e-b644-598f812b9617) Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.593378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:29:43.595306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 14:29:43.598414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-013db6d9-016b-49cd-87b2-6e89deb192c0 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] Returning 404 to user: Volume 34903f35-844e-465a-92a6-fec52cdb7cae could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-013db6d9-016b-49cd-87b2-6e89deb192c0 tempest-VolumesSnapshotsTestJSON-556158222 tempest-VolumesSnapshotsTestJSON-556158222-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae" status: 404 len: 109 microversion: 2.1 time: 0.092036 Oct 04 14:29:43.602363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:29:43 2022] GET /compute/v2.1/os-volumes/34903f35-844e-465a-92a6-fec52cdb7cae => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:29:47.386653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-69acb3a8-280e-469f-b0be-df13531dddac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: .version_select at 0x7f5719eac700>, body: {"keypair": {"name": "tempest-keypair-232781648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqvt/g24bAAwhoqz7IupX8+73DCGKpRikNrXOJxpUBoZ+OHTF/Dn2g2FjMWgvLHjm54wQyvXRKrlnu2yUny6A4vMXOLtjEaNlCo4Yx3lwTpmdqdArSie481o4b9aZtlnw=="}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:47.528236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-69acb3a8-280e-469f-b0be-df13531dddac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:29:47.552986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-69acb3a8-280e-469f-b0be-df13531dddac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:29:47.695222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-69acb3a8-280e-469f-b0be-df13531dddac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.894822 Oct 04 14:29:47.707087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 13/25] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:29:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:29:51.139306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2046601612", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:51.532816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] validate_networks() for [('f70b9727-7199-4fe7-bb77-16baf61f7e49', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:29:52.765347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2710eec9-3385-42b1-b515-0faa1d84ad37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'create', calling method: .version_select at 0x7f57194a1430>, body: {"keypair": {"name": "tempest-keypair-210054834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzA0NZ3Fl5sXpLY/7pIiedEK2LT6Xiq3Co9/kZaiWXfyG8/diGItthMIBBo7nDUV6ymMsTR73TAh16es7OVFYcjXBCe+nX2fIqoh9HeDqlszuLeNuyUBBRlxm9y8lmn0g=="}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:52.830234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-2710eec9-3385-42b1-b515-0faa1d84ad37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for project 64993786e21b45beb7829ceaede4777a. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:29:52.851720 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-2710eec9-3385-42b1-b515-0faa1d84ad37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for user c5b38375d6ff4d0db0f3f7bc89ca8798 and project 64993786e21b45beb7829ceaede4777a. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:29:52.935486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2710eec9-3385-42b1-b515-0faa1d84ad37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.722672 Oct 04 14:29:52.936460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 14/26] 10.222.0.64 () {62 vars in 1200 bytes} [Tue Oct 4 14:29:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 724 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 04 14:29:55.103445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:29:55.104057 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:29:55.104376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:29:55.104796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:29:55.105217 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:29:55.163676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:29:55.164468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:29:55.164913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:29:55.165670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:29:55.166125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:29:55.166567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:29:55.286390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:29:55.310404 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for user 2b4c980bac3e444faa0e6f1a1d270cfa and project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:29:55.349108 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:29:55.359545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:29:55.560381 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c76f3f7d-6680-4745-89ce-19feb3b64f02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.312903 Oct 04 14:29:55.560588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 13/27] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:29:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 5322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:29:55.573124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc2ccfd3-f10c-4e42-a3b3-86e963d8d0a6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:29:55.573888 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bc2ccfd3-f10c-4e42-a3b3-86e963d8d0a6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:29:55.841087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bc2ccfd3-f10c-4e42-a3b3-86e963d8d0a6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:29:55.891361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bc2ccfd3-f10c-4e42-a3b3-86e963d8d0a6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1222 microversion: 2.1 time: 0.320033 Oct 04 14:29:55.896771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 15/28] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:29:55 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1222 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:29:56.223221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-982006667", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:56.328769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] validate_networks() for [('f70b9727-7199-4fe7-bb77-16baf61f7e49', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:29:56.652536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1323491388", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e89e862-e669-4987-af44-eb18dbc3b78d"}], "security_groups": [{"name": "tempest-securitygroup--1732404246"}], "key_name": "tempest-keypair-232781648", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:57.251244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] validate_networks() for [('3e89e862-e669-4987-af44-eb18dbc3b78d', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:29:58.034390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:29:58.034989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:29:58.037754 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:29:58.041336 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:29:58.043055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:29:58.084642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:29:58.091846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:29:58.092330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:29:58.093335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:29:58.095858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:29:58.098133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:29:58.143104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:29:58.150157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for user 2b4c980bac3e444faa0e6f1a1d270cfa and project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:29:58.176302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:29:58.181989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:29:58.328977 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3a21cce4-8318-4a6b-9b07-ebae6cf916d6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.115570 Oct 04 14:29:58.329894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 14/29] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:29:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:29:58.886869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1277201639", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "networks": [{"uuid": "1e8ee100-9e5b-4809-8cb0-dbfff2298b1e"}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:29:59.048652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] validate_networks() for [('1e8ee100-9e5b-4809-8cb0-dbfff2298b1e', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:30:00.158191 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:30:00.160149 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:30:00.161715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:30:00.162722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:30:00.164151 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:30:00.205000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:00.206829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:00.207595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:00.213472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:00.216432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:00.221603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:00.292844 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:30:00.299299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:30:00.315337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:30:00.320027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:30:00.511089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-13712344-9216-41c6-a9c6-8ac7acd5a1e3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.870093 Oct 04 14:30:00.524367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 16/30] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:29:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:30:00.901342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:30:00.901893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:30:00.902224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:30:00.902630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:30:00.903037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:30:00.931140 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:00.931709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:00.932160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:00.934589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:00.936968 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:00.938097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:00.989681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Getting quotas for project da10281be41c43988e60ecfafd5d0d12. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:30:00.998639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Getting quotas for user 3f6d20541ee8417ba718190c88c48deb and project da10281be41c43988e60ecfafd5d0d12. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:30:01.048885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:30:01.051449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:30:01.287416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f4412527-3c32-4b55-aa68-93d41b30db85 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.947952 Oct 04 14:30:01.301155 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 15/31] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:30:01.324073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:01.324726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:01.393029 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:01.403741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:01.406379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:01.409435 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:01.414138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:01.425315 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:01.708463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-47800b9d-fd98-464d-aacb-0eecae4b0360 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: .version_select at 0x7f5719391ee0>, body: {"keypair": {"name": "tempest-keypair-1021671863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2aQspdpLsapeMzfWalkv96qTV5DTGHMmseIhnmIdDk9EeJsbl4gQWqvh/bBjswNrGAxPZQM1KM8Sn7bdKWS4fbgxzfflWiYYydgoB6uAW/vWUXVh2qOI3soB3zG8OMog=="}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:01.794746 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-47800b9d-fd98-464d-aacb-0eecae4b0360 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:30:01.823095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-47800b9d-fd98-464d-aacb-0eecae4b0360 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for user fc02bb4b8a32400faef8743d2418a648 and project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:30:01.982249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-47800b9d-fd98-464d-aacb-0eecae4b0360 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.445004 Oct 04 14:30:01.988615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 17/32] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:30:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:02.003657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7a15bd6e-c2e3-4469-b9ef-ed14494f60b0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:02.004279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7a15bd6e-c2e3-4469-b9ef-ed14494f60b0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:02.523276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:02.583672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e895f470-38a3-40b3-b6f3-98d73b2de550 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1273 microversion: 2.1 time: 1.275343 Oct 04 14:30:02.588571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 16/33] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:01 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1273 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:02.605056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e83d459e-76d8-454b-99d1-4783905d8806 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:02.607431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e83d459e-76d8-454b-99d1-4783905d8806 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:02.608158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7a15bd6e-c2e3-4469-b9ef-ed14494f60b0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:02.621994 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7a15bd6e-c2e3-4469-b9ef-ed14494f60b0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1241 microversion: 2.1 time: 0.631834 Oct 04 14:30:02.622871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 18/34] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:01 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1241 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:02.814546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e83d459e-76d8-454b-99d1-4783905d8806 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:02.853318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e83d459e-76d8-454b-99d1-4783905d8806 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1215 microversion: 2.1 time: 0.262958 Oct 04 14:30:02.868356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 17/35] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:02 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1215 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:03.601484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1395251373", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8adffcb3-eb41-48c9-bdc6-30a7213ac01c"}], "security_groups": [{"name": "tempest-securitygroup--2128211051"}], "key_name": "tempest-keypair-210054834", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:03.625416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:03.634244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:03.683550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:03.684048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:03.700617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:03.701491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:03.701980 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:03.702413 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:04.051445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:04.081343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-13362efc-d0fd-42c6-a6b7-8c445b945c4a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1279 microversion: 2.1 time: 0.462087 Oct 04 14:30:04.083252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:03 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1279 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:04.103003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:04.103638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:04.133223 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:04.133836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:04.134401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:04.135044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:04.138667 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:04.138667 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:04.350095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:04.367646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fbf1603b-3a49-496f-a278-218a822d8be9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1293 microversion: 2.1 time: 0.280364 Oct 04 14:30:04.373400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:04 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:04.391274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:04.393718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:04.422401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:04.424875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:04.426454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:04.430574 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:04.435429 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:04.436168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:04.734711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:04.745250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3a073018-c4f7-4bcf-bcfc-87cae048841b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1211 microversion: 2.1 time: 0.370534 Oct 04 14:30:04.763096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 20/38] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:04 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1211 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:05.145116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:05.160619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:05.216909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:05.218477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:05.228181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:05.237801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:05.238636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:05.241606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:05.680705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:05.730885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] validate_networks() for [('8adffcb3-eb41-48c9-bdc6-30a7213ac01c', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:30:05.767830 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bdee1a28-0bec-4cff-b78a-aaa77800e183 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1279 microversion: 2.1 time: 0.657754 Oct 04 14:30:05.775568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 21/39] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:05 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1279 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:05.814589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:05.815697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:05.861172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:05.869104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:05.870813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:05.872498 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:05.873635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:05.875475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:06.141262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:06.149628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0fa74adf-0bbe-48c4-8f70-a54a206e37a6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1299 microversion: 2.1 time: 0.372331 Oct 04 14:30:06.162538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:05 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1299 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:06.176558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:06.176558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:06.203522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:06.208821 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:06.211106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:06.214301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:06.216937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:06.220346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:06.557336 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:06.579772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4ddc7728-a47f-4429-9424-32b7d7cf9422 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1267 microversion: 2.1 time: 0.413835 Oct 04 14:30:06.607465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 23/41] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:06 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1267 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:06.803092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:06.804550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:06.822218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:06.826608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:06.831181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:06.832372 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:06.833001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:06.834960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:07.321513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:07.343758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2130aa05-10bb-4274-8554-2a370dec572d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1279 microversion: 2.1 time: 0.538306 Oct 04 14:30:07.349811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 24/42] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:06 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1279 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:07.392430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:07.393588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:07.423260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:07.478723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:07.479637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.056s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:07.497079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:07.497960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:07.500970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:07.748481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:07.763511 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-af2d7a50-5bfa-4089-82b7-420da50392be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1299 microversion: 2.1 time: 0.408692 Oct 04 14:30:07.770178 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 25/43] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:07 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:07.797635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:07.802862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:07.826103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:07.827675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:07.829755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:07.832243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:07.833044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:07.835978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:08.212711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:08.228008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-564a6b10-6311-41c8-b3ee-897287efca9a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1273 microversion: 2.1 time: 0.456470 Oct 04 14:30:08.238458 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 26/44] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:07 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1273 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:08.371917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:08.373320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:08.394463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:08.394956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:08.405876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:08.409599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:08.413797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:08.415175 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:08.825118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:08.854028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-90a35c87-9a38-40c9-b373-b22b63f96526 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1279 microversion: 2.1 time: 0.483788 Oct 04 14:30:08.869475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 27/45] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:08 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1279 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:08.878323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:08.879388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:08.888881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:08.888881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:08.888881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:08.889581 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:08.890412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:08.891086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.128420 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:09.139488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4ef26c8e-43c4-42d4-bfb2-726630c87558 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1299 microversion: 2.1 time: 0.268555 Oct 04 14:30:09.145775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 28/46] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:08 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:09.263766 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:09.264513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:09.273424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:09.276827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:09.277538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.279105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:09.286929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:09.287381 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.539661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:09.550388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ad3345f9-c7ea-446a-9961-963787382248 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1273 microversion: 2.1 time: 0.290521 Oct 04 14:30:09.550954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 29/47] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:09 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1273 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:09.675723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:30:09.675723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:30:09.676377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:30:09.676377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:30:09.676956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:30:09.703263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:09.704052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:09.704686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.705757 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:09.706440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:09.707034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.730108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for project 64993786e21b45beb7829ceaede4777a. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:30:09.735069 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for user c5b38375d6ff4d0db0f3f7bc89ca8798 and project 64993786e21b45beb7829ceaede4777a. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:30:09.774273 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:30:09.778561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:30:09.883713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:09.884570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:09.901474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:09.903165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:09.906059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.909639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:09.912352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:09.914430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:09.951324 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1018f7aa-9c62-4b3e-b6fc-9f2d72a112ae tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.355046 Oct 04 14:30:09.963410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 19/48] 10.222.0.64 () {62 vars in 1188 bytes} [Tue Oct 4 14:30:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 6368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 14:30:09.972989 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bb6dbe06-13c5-48b2-8f64-f38f57751518 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:09.976148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bb6dbe06-13c5-48b2-8f64-f38f57751518 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:10.836263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bb6dbe06-13c5-48b2-8f64-f38f57751518 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:10.854072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bb6dbe06-13c5-48b2-8f64-f38f57751518 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:10.856112 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bb6dbe06-13c5-48b2-8f64-f38f57751518 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:10.861423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bb6dbe06-13c5-48b2-8f64-f38f57751518 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1281 microversion: 2.20 time: 0.896389 Oct 04 14:30:10.862004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 20/49] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:09 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1281 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:10.875992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:10.888836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:10.922477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:10.923999 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:10.924466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:10.925192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:10.925635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:10.952690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:10.960646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=6 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:12.049826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:12.063377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5e0ba665-521e-4e30-a34e-b001405ceff9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 2.185713 Oct 04 14:30:12.067675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 30/50] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:09 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:12.081859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:12.082519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:12.117757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:12.118810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:12.128221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:12.129403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:12.130159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:12.133056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:12.279716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:12.289467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b68401ff-e7c6-4530-add5-92af7307d57d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1273 microversion: 2.1 time: 0.217480 Oct 04 14:30:12.290151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 31/51] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:12 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:12.318477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:12.319310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:12.357992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:12.359991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:12.360502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:12.361246 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:12.363825 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:12.364450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:12.502949 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:12.832144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=20 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:12.845725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:12.866726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:12.872584 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:12.874036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f6580a4e-7152-4a89-95ba-10430ea37bc1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1333 microversion: 2.20 time: 0.572456 Oct 04 14:30:12.889125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 32/52] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:12 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1333 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:13.090910 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:13.092292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:13.100585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:13.117215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:13.127225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:13.131304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:13.141614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:13.143631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:13.968863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:14.006021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e804e333-2bf1-43ee-8e5f-cfce0f449b42 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 3.142916 Oct 04 14:30:14.010635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 21/53] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:10 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:14.027451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:14.034978 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:14.050513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:14.052884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:14.057100 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:14.057891 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:14.071173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:14.071863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:14.074836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:14.822188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:14.831324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-28307954-3bd9-440c-951a-d0af8322bdcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 1.744297 Oct 04 14:30:14.836231 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 33/54] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:13 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:14.849512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:14.859844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:14.874131 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:14.876747 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:14.879301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:14.881177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:14.884432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:14.885182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:15.100729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:15.120285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5800a2f5-6a56-4b23-85a7-4c70c3d537bb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1273 microversion: 2.1 time: 1.096556 Oct 04 14:30:15.121842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 22/55] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:14 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1273 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:15.132736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:15.135486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:15.158760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:15.160403 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:15.161475 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:15.164403 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:15.165276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:15.172067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:15.407193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:15.463948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:15.465590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:15.466961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2da0e28b-b33e-4eb7-b3b3-c849165c901a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1339 microversion: 2.20 time: 0.624330 Oct 04 14:30:15.467615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 34/56] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:14 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1339 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:15.859343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:15.861277 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:15.898814 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:15.900733 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:15.904931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:15.906583 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:15.909944 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:15.911996 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:17.215497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:17.237331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5107250c-d151-4295-bc52-929b6dde7c2f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 2.110357 Oct 04 14:30:17.238294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 23/57] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:15 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:17.265355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:17.271164 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:17.294729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:17.295493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:17.296094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:17.297226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:17.297840 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:17.298542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:17.808060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:17.844462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e5855f1f-d08c-48e5-b4dd-7e60c504dd46 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 1.985195 Oct 04 14:30:17.868612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 35/58] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:15 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:17.892773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:17.900249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:17.950723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:17.951718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:17.952274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:17.953113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:17.955487 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:17.957707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:18.336278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:18.389538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:18.391556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:18.394102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-40b823a0-c781-48ec-ab2c-1c8c9c11769a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1339 microversion: 2.20 time: 0.513771 Oct 04 14:30:18.394797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 36/59] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:17 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1339 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:18.524164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79b4aa2-e418-4cb4-affc-2cbf5df8547c", "tag": "b74df40d-d043-4af9-93a2-e99ed587df20"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:18.549499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:18.549976 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:18.550400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:18.564223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:18.588810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b74c34ba-0397-4860-bc00-41aafab9bad2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 1.341685 Oct 04 14:30:18.592492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 24/60] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:17 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:18.602369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1673260527", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c224c131-1e09-47f0-b40a-1a73221baea0"}], "security_groups": [{"name": "tempest-securitygroup--1298049798"}], "key_name": "tempest-keypair-1021671863", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:18.609144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Creating event network-changed:b74df40d-d043-4af9-93a2-e99ed587df20 for instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c on hv-cinder-86026 Oct 04 14:30:18.610098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 14:30:18.617652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-95db181e-8913-4c64-b8dc-956cf0e3ea6b req-35e44ae6-966f-4234-b97d-762ebcb99c18 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 14:30:18.620091 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:18.622876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:18.628593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:18.629815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:18.631462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:18.632634 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:18.682627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.compute.rpcapi [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 14:30:18.685400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 14:30:18.706666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1bcd5a3c-3eef-41b3-acba-440888a105c1 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305684 Oct 04 14:30:18.708003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 37/61] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:18.715536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:18.716658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:18.726374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:18.727206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:18.727844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:18.729122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:18.730116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:18.730983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:18.941475 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] validate_networks() for [('c224c131-1e09-47f0-b40a-1a73221baea0', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:30:19.236834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:19.253813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bbc91ec9-68f5-410a-b54c-506fa7c4e882 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.538816 Oct 04 14:30:19.267590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 38/62] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:18 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:19.283495 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:19.284365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:19.295876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:19.296954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:19.298566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:19.299890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:19.300607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:19.301235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:19.724337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:19.962430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:20.019345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-878c8df2-0d98-41c8-a754-6829875581c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.743098 Oct 04 14:30:20.024588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 39/63] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:19 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:20.340626 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-6dfecd29-417f-4053-b937-c036ebbbd12d req-d2b1de1f-7f57-4aca-b572-c2e93d1181d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92da7788-17c4-4129-b353-b25576213350", "tag": "3a45f381-06ca-4183-af22-7b3ce0bb06a4"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:20.353561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:20.372182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-6dfecd29-417f-4053-b937-c036ebbbd12d req-d2b1de1f-7f57-4aca-b572-c2e93d1181d4 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.375413 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-6dfecd29-417f-4053-b937-c036ebbbd12d req-d2b1de1f-7f57-4aca-b572-c2e93d1181d4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.376496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-6dfecd29-417f-4053-b937-c036ebbbd12d req-d2b1de1f-7f57-4aca-b572-c2e93d1181d4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.449597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-6dfecd29-417f-4053-b937-c036ebbbd12d req-d2b1de1f-7f57-4aca-b572-c2e93d1181d4 service nova] Creating event network-changed:3a45f381-06ca-4183-af22-7b3ce0bb06a4 for instance 92da7788-17c4-4129-b353-b25576213350 on hv-cinder-86026 Oct 04 14:30:20.467017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:30:20.467488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:30:20.467972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:30:20.468416 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:30:20.469072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:30:20.479270 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-6dfecd29-417f-4053-b937-c036ebbbd12d req-d2b1de1f-7f57-4aca-b572-c2e93d1181d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452062 Oct 04 14:30:20.483207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 40/64] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:20.499548 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=31 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:20.503375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.504853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.505306 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.506788 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.507417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.507585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:20.513651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.515466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:20.535438 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.536967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.538025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.540712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.541784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.542995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.568019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:30:20.582839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for user fc02bb4b8a32400faef8743d2418a648 and project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:30:20.608188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:30:20.610567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:30:20.716159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-28774772-6788-4590-ab19-f54b70adbec0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.121856 Oct 04 14:30:20.724088 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 25/65] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:30:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:30:20.730687 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:20.732232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:20.755858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.757854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.758305 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.759030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.759493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.759922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.820658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:20.832711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:20.837781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:20.839425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-29e5024f-ce3a-49b0-9560-95b97881b4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.353807 Oct 04 14:30:20.845573 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 41/66] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:20 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:20.857034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:20.857680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:20.871033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.871490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.872367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.875480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:20.875996 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:20.876472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:20.974756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:20.992693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3e5a6d48-168e-4cd4-8b4f-3a6befde8f96 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.265405 Oct 04 14:30:20.993342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 26/67] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:20 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:21.003317 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-75b5781f-1865-4982-a106-35af5abff2d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:21.007604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-75b5781f-1865-4982-a106-35af5abff2d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:21.150266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:21.153934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-75b5781f-1865-4982-a106-35af5abff2d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:21.165189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-75b5781f-1865-4982-a106-35af5abff2d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1238 microversion: 2.1 time: 0.170495 Oct 04 14:30:21.166359 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 27/68] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:20 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1238 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:21.171936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd38da3-9e0e-426c-b4a2-9c582119f22f", "tag": "fdd48946-1df6-48c0-871f-7f58d52dcaba"}, {"name": "network-changed", "server_uuid": "a76166c5-baf9-4033-be8c-b138512c2fdc", "tag": "d9a62f08-f97c-4b57-912d-1b054d110489"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:21.191965 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.193067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.193650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.194868 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-268fe765-8cd6-45fb-8ed5-f82f64071c87 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.347284 Oct 04 14:30:21.195959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 42/69] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:20 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:21.214633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:21.215649 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:21.234549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.238139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.238313 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Creating event network-changed:fdd48946-1df6-48c0-871f-7f58d52dcaba for instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f on hv-cinder-86026 Oct 04 14:30:21.238789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Creating event network-changed:d9a62f08-f97c-4b57-912d-1b054d110489 for instance a76166c5-baf9-4033-be8c-b138512c2fdc on hv-cinder-86026 Oct 04 14:30:21.239560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 14:30:21.241120 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-61e2a998-2c4f-4fa9-9578-23d16e376507 req-a55e153f-56fd-4833-8e33-54555ae15122 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 14:30:21.241744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.242695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.242871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.243188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.243417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.243626 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.244111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.244889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.245384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.245794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.259379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.compute.rpcapi [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 14:30:21.261257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] Releasing lock "compute-rpcapi-router" {{(pid=120820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 14:30:21.316293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-29003a4d-9cb3-4402-9883-c0e0fe45dadc None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.146032 Oct 04 14:30:21.337572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 28/70] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:21.867686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:21.868358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:21.870709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:21.876408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.877099 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.880689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.882175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:21.882520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-69febc7e-6fc5-47de-85f7-2d13f6ee4a7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.680093 Oct 04 14:30:21.882932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:21.883437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:21.897660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 43/71] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:21 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:22.019697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:22.021444 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:22.030395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.031363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.032014 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.033317 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.033842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.034460 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.056671 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:22.067567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:22.069677 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:22.071234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8f759e52-c5ef-47b9-af1d-cb9736505640 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.209457 Oct 04 14:30:22.080133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 29/72] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:21 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:22.215372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:22.216356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:22.225684 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.226232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.226988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.228530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.229082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.229726 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.232926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=47 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:22.331050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:22.348084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f8bf3425-f2e5-4ff8-a8d6-4feb05933aee tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1242 microversion: 2.1 time: 0.152345 Oct 04 14:30:22.360270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 30/73] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:22 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:22.371074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:22.371693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:22.377948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:22.380702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.381978 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.382579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.383623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.384218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.384804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.388690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-431b6d00-11c9-4c9e-a205-73ca24316250 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.374525 Oct 04 14:30:22.389588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 44/74] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:22 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:22.580416 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:22.590273 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a989229c-539a-4e14-8f25-cd2f1c552147 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.227303 Oct 04 14:30:22.591503 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 31/75] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:22 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:22.659428 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-0bac6477-11d2-45b1-9494-6f43f414e465 req-d13bb267-67c1-4819-9ca1-70e6d6410f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:22.679528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0bac6477-11d2-45b1-9494-6f43f414e465 req-d13bb267-67c1-4819-9ca1-70e6d6410f37 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.680434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0bac6477-11d2-45b1-9494-6f43f414e465 req-d13bb267-67c1-4819-9ca1-70e6d6410f37 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.681206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0bac6477-11d2-45b1-9494-6f43f414e465 req-d13bb267-67c1-4819-9ca1-70e6d6410f37 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.702590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-0bac6477-11d2-45b1-9494-6f43f414e465 req-d13bb267-67c1-4819-9ca1-70e6d6410f37 service nova] Creating event network-changed:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:30:22.712118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-0bac6477-11d2-45b1-9494-6f43f414e465 req-d13bb267-67c1-4819-9ca1-70e6d6410f37 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062683 Oct 04 14:30:22.713329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 45/76] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:22.906707 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:22.907258 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:22.917822 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.918328 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.918743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:22.919444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:22.919890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:22.920328 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.066694 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.075504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-02cc8291-e733-4fbd-a029-dc00a69e631a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.172835 Oct 04 14:30:23.076091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 32/77] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:22 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:23.098363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:23.099054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:23.106444 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.106932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.107365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.108073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.108556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.108974 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.250825 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.259891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.261366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.262467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e68818d3-13d3-4f1e-b94f-269a18521795 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.168627 Oct 04 14:30:23.263021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 46/78] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:23 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:23.378524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:23.379649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:23.388793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.389292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.389765 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.390485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.390982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.391501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.413053 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:23.413971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:23.420085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.420600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.421059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.421784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.422262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.422686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.457290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.466246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-59f31710-0b40-4de1-b0d5-639b5d7efa71 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1242 microversion: 2.1 time: 0.095782 Oct 04 14:30:23.466822 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 33/79] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:23 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:23.557713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.566014 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-25150489-b31d-4e6b-9ce3-6bbf5e231d09 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.157396 Oct 04 14:30:23.566598 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 47/80] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:23 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:23.629683 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:23.630295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:23.637084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.637567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.638001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.638690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:23.639143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:23.639561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:23.778075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:23.788779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-23076d0c-fd71-4fa2-a281-b8ef851c5451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.162812 Oct 04 14:30:23.789429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 34/81] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:23 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:24.098899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:24.100184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:24.106835 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.107636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.108338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.109065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.109521 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.109947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.263494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:24.271419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-08d2cc40-17e5-47ed-8b62-5828b707d490 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.177058 Oct 04 14:30:24.272048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 48/82] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:24 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:24.290610 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:24.293176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:24.300631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.301387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.302012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.303569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.304080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.304676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.479710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:24.489276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:24.489542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:24.489976 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:24.492038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:24.493197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8e0062d1-9e23-47e2-8910-3d08593f3ccc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.207307 Oct 04 14:30:24.493769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 35/83] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:24 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:24.497008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.497462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.497903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.498637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.499092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.499520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.564904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:24.575597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f4f72c42-4a25-467f-808b-331edaa0d9a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1242 microversion: 2.1 time: 0.089885 Oct 04 14:30:24.576731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 49/84] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:24 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:24.603749 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:24.604442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:24.610486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.610968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.611405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.612109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.612587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.613006 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.756531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:24.764290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ff0e5b57-d879-4cd1-9097-c9af98a60b82 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.165210 Oct 04 14:30:24.764876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 36/85] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:24 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:24.812487 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:24.813174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:24.821841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.822480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.823285 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.824556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:24.825247 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:24.825978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:24.995482 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:25.002499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:25.011348 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1fce2007-9043-4317-b37b-d6745c728de5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.201652 Oct 04 14:30:25.013250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 50/86] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:24 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:25.294621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:25.295251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:25.301338 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.301811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.302239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.303179 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.303660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.304081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.526568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:25.531995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:25.550545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.551031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.551468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.552179 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.553450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.553989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.583897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:25.598558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3ae8ccc0-2276-4af8-b3a9-4cf89e36f129 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.307698 Oct 04 14:30:25.601676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 37/87] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:25 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:25.609932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:25.616817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:25.627115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.628152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.628866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.629842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.633002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.633686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.884541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:25.894853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f672e1fc-27a9-4245-a3e7-a85d7d599979 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1234 microversion: 2.1 time: 0.290488 Oct 04 14:30:25.902221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 38/88] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:25 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1234 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:25.916429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:25.918824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:25.929916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.931706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.932383 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:25.933903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:25.935992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:25.936672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:26.202180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:26.216475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:26.219185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:26.223117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c8e8088b-1307-4912-b16d-7bc40b889283 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.705409 Oct 04 14:30:26.225178 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 51/89] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:25 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:30:26.237756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:26.238801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:26.246176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:26.246932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:26.247813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:26.250772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:26.251695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:26.252358 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:26.319458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:26.333140 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-815753d9-204e-456e-8cdc-6aec146e455f tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.428658 Oct 04 14:30:26.335599 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 39/90] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:25 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:26.626591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:26.627209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:26.636458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:26.637547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:26.638638 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:26.639897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:26.640810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:26.641470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:26.947362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.022339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fddb3a30-7fb2-4ae6-8d7d-195f0b7bc84c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.768810 Oct 04 14:30:27.023046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 52/91] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:26 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:27.036441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:27.042499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:27.050827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:27.051614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:27.052406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:27.053712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:27.054832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:27.055550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:27.090032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.102237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ab2e1422-1e38-48d7-b830-a9397603f821 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.479662 Oct 04 14:30:27.103255 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 40/92] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:26 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:27.142686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.151682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-200b66a6-2449-429b-a36d-23eb300dd6b3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1296 microversion: 2.1 time: 0.124345 Oct 04 14:30:27.153122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 53/93] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:27 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1296 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:27.255042 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:27.256089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:27.264467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:27.265137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:27.266003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:27.266847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:27.267394 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:27.267935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:27.368946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:27.370274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:27.378565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:27.379710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:27.380434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:27.382169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:27.382990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:27.383680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:27.468041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.480095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.482382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.483584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8cf4818e-703b-41c0-aecd-afad5adb4a2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.233038 Oct 04 14:30:27.484556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 41/94] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:27 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:27.593873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:27.607449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-37b74b5b-6183-4e72-90f7-525d5f8d7c26 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.247178 Oct 04 14:30:27.610190 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 54/95] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:27 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:28.047576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:28.048296 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:28.055411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.055897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.056354 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.057071 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.057724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.057984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.132784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:28.133638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:28.140869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.141384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.141791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.142498 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.142948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.143368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.227695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:28.245375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-89849233-361a-4694-b1f8-187736ba27a7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.201690 Oct 04 14:30:28.246638 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 42/96] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:28 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:28.251724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:28.252433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:28.259544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.260453 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.261042 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.261984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.262846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.263304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.319627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:28.329827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-79535e49-5e24-422c-aa7e-181688aa5769 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.201683 Oct 04 14:30:28.330403 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:28.330883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 55/97] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:28 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:28.341098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-41af2535-c72a-4753-8739-70e44c7aed60 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1296 microversion: 2.1 time: 0.093244 Oct 04 14:30:28.341743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 43/98] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:28 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:28.515024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:28.515666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:28.523670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.524151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.524783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.525887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.526827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.527238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.642511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:28.647050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:28.668790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:28.669213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.669752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.670248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:28.670981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:28.671433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:28.671892 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.196619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:29.212274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:29.214054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:29.217615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7c452525-af3e-4da6-beb8-9e2fa12e6e79 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.706976 Oct 04 14:30:29.224167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 56/99] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:28 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:29.271964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:29.272843 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:29.291085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:29.292883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:29.293550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.294599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:29.295278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:29.296346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.373234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:29.392030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-77b854bd-f996-4fd3-97bb-03bfcecd12ed tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.756304 Oct 04 14:30:29.400966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 44/100] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:28 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:29.424592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:29.426090 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:29.449948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:29.451917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:29.453391 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.454477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:29.457558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:29.461579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.752094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:29.763952 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-00cfbc06-a7fb-4b0c-b211-659f73958ffe tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.496671 Oct 04 14:30:29.765261 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 57/101] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:29 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:29.774557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:29.775604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:29.786575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:29.787929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:29.788715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.791566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:29.793052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:29.793818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:29.855657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:29.874171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-062dd01c-7575-477c-ac5f-d2453e302977 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.469362 Oct 04 14:30:29.875298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 45/102] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:29 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:30.143227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:30.171468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0d98ddfe-74da-49bb-9967-c7b19b02f463 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1296 microversion: 2.1 time: 0.401509 Oct 04 14:30:30.192261 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 58/103] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:29 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1296 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:30.254617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:30.255232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:30.284264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:30.284835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:30.285300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:30.286052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:30.290866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:30.291629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:30.460191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:30.462438 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:30.474483 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:30.475385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:30.475992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:30.476961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:30.485935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:30.486659 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.112218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:31.136728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b339de5f-966f-400f-aea4-487f4b99546b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.709891 Oct 04 14:30:31.139891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 59/104] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:30 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:31.160829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=7 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:31.164412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:31.168177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:31.183421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:31.186466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:31.187003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.193739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:31.194454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:31.197541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.257024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:31.428124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:31.435866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:31.455988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:31.461453 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:31.469467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-22528653-5f0f-4781-87ee-ac138930e45d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 1.218508 Oct 04 14:30:31.490787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 46/105] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:30 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:31.498297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:31.499756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:31.508180 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:31.509203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:31.509613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.510651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:31.511806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:31.512439 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.872046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:31.882042 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-274da712-027b-49fe-acb1-f76d237328eb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.389809 Oct 04 14:30:31.883501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 47/106] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:31 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:31.889786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:31.890862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:31.897201 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:31.901268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:31.902018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:31.902865 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.903762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:31.904426 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:31.905014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:31.910783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5f170e60-c1de-44e0-879f-0974f57e3d58 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.767455 Oct 04 14:30:31.936472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 60/107] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:31 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:32.113176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-82a5b01d-b9c0-4457-97af-e9e9339c0f1f req-5d67a22d-55d5-44a5-b7d7-405bf8c9d5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79b4aa2-e418-4cb4-affc-2cbf5df8547c", "name": "network-vif-plugged", "status": "completed", "tag": "b74df40d-d043-4af9-93a2-e99ed587df20"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:32.127829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-82a5b01d-b9c0-4457-97af-e9e9339c0f1f req-5d67a22d-55d5-44a5-b7d7-405bf8c9d5d6 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.129687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-82a5b01d-b9c0-4457-97af-e9e9339c0f1f req-5d67a22d-55d5-44a5-b7d7-405bf8c9d5d6 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.130321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-82a5b01d-b9c0-4457-97af-e9e9339c0f1f req-5d67a22d-55d5-44a5-b7d7-405bf8c9d5d6 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:32.167542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-82a5b01d-b9c0-4457-97af-e9e9339c0f1f req-5d67a22d-55d5-44a5-b7d7-405bf8c9d5d6 service nova] Creating event network-vif-plugged:b74df40d-d043-4af9-93a2-e99ed587df20 for instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c on hv-cinder-86026 Oct 04 14:30:32.183487 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-82a5b01d-b9c0-4457-97af-e9e9339c0f1f req-5d67a22d-55d5-44a5-b7d7-405bf8c9d5d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245290 Oct 04 14:30:32.186571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 61/108] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:32.198744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:32.199577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:32.200545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:32.208824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6c2d9ba7-0fe5-47cc-9182-231c73bdf616 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.323374 Oct 04 14:30:32.213109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 48/109] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:31 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:32.221294 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.221989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.222445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:32.223157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.223603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.224016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:32.506517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:32.507496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:32.515736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.516721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.517317 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:32.518093 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.518543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.519094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:32.819643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:32.840670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e9ed1560-a90e-4b54-b4dd-6a7788de1ddb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.647619 Oct 04 14:30:32.853055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 62/110] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:32 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:32.917574 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:32.918970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:32.928945 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.931196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.932019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:32.935882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:32.938969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:32.941509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:33.537713 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:33.552119 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:33.556186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:33.557744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2bb6ace8-881f-4e11-842d-a9c1db1abeb3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 1.056588 Oct 04 14:30:33.575166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 49/111] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:32 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:30:33.579472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:33.589955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:33.590841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:33.600770 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:33.601715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:33.602448 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:33.603621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:33.604294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:33.604990 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:33.617263 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-27c55f51-a377-42ff-83c1-83966fdf1f7f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.711438 Oct 04 14:30:33.617869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 63/112] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:32 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:33.627034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:33.627879 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:33.666467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:33.667201 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:33.667636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:33.673519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:33.674105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:33.674535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:33.970581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:33.982106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f7dfdf75-af10-4c83-905a-5be2c0d91d96 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.404719 Oct 04 14:30:33.983780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 50/113] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:33 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:33.994764 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:33.995506 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:34.010220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.011055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.011832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.012795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.013561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.014952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.119483 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:34.153301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-166a2b31-fa20-4740-9ff0-59b9e296d671 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.531534 Oct 04 14:30:34.154810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 64/114] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:33 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:34.166992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-c92682af-b8b8-4f55-b26e-66948836d327 req-0ea8f17d-f300-4265-b31c-e7419a31a9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d55b4f-410d-4527-a9d3-15f1942a46d0", "tag": "4f9df3e5-1e5c-45b5-9628-2769911f67a4"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:34.179727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-c92682af-b8b8-4f55-b26e-66948836d327 req-0ea8f17d-f300-4265-b31c-e7419a31a9f4 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.181296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-c92682af-b8b8-4f55-b26e-66948836d327 req-0ea8f17d-f300-4265-b31c-e7419a31a9f4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.181899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-c92682af-b8b8-4f55-b26e-66948836d327 req-0ea8f17d-f300-4265-b31c-e7419a31a9f4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.198030 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-c92682af-b8b8-4f55-b26e-66948836d327 req-0ea8f17d-f300-4265-b31c-e7419a31a9f4 service nova] Creating event network-changed:4f9df3e5-1e5c-45b5-9628-2769911f67a4 for instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 on hv-cinder-86026 Oct 04 14:30:34.204955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-c92682af-b8b8-4f55-b26e-66948836d327 req-0ea8f17d-f300-4265-b31c-e7419a31a9f4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048333 Oct 04 14:30:34.205849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 65/115] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:34.215434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:34.223613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6623b257-f473-48b5-8f3c-6a0a7de979f1 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.238401 Oct 04 14:30:34.224918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 51/116] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:33 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:34.592805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:34.594023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:34.606154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.606727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.607272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.608177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.608699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.609290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.656582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:34.657996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:34.665785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.666271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.667436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.668248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:34.668761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:34.669366 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:34.847761 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:34.858102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:34.861754 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:34.862906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4c027c29-affd-4b9f-901d-767e25e96219 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.276829 Oct 04 14:30:34.863810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 66/117] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:34 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:34.866874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:34.884139 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-15a2a62b-f66e-440b-972b-0797a6a9d298 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.231752 Oct 04 14:30:34.884853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 52/118] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:34 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:35.014410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:35.015017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:35.023437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.024055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.025549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.026398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.026841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.027450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.180715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:35.181555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:35.194923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.195420 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.196034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.199493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.203093 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.203784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.205404 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:35.215375 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fa85f240-e3c2-4b4e-8b52-f306f963913a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.205503 Oct 04 14:30:35.216356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 67/119] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:35 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:35.247059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:35.248205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:35.262170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.263644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.265765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.266557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.267040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.267477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.399360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:35.411677 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bcc6b481-4b93-454c-9427-a5158bc59cc6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.236279 Oct 04 14:30:35.412528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 53/120] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:35 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:35.452715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:35.456670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:35.462885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-65d63ae0-b246-49c7-bdeb-e162e241a87d tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.219601 Oct 04 14:30:35.465234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 68/121] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:35 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:35.889699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:35.892238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:35.901159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.901747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.902245 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.903193 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.904057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.904941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.910239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:35.910869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:35.918512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.919229 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.920029 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:35.921023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:35.921776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:35.922534 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.089089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.099579 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b5dfeab5-e4f5-428c-8e93-40396fed4187 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.194576 Oct 04 14:30:36.100800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 69/122] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:35 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:36.132890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.144063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.145574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.148174 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9d37e48a-d9c7-48a6-aee9-9c9876e77abd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.262716 Oct 04 14:30:36.148983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 54/123] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:35 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:36.238315 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:36.240657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:36.247974 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:36.248662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:36.249342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.250090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:36.250544 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:36.251324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.414350 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.425369 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-df3ef257-fce8-4219-abe3-4bac6184a1ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.190770 Oct 04 14:30:36.425958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 70/124] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:36 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:36.436251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:36.437190 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:36.446353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:36.447132 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:36.447766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.448727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:36.449558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:36.449997 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.486587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:36.487199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:36.496623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:36.497151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:36.497569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.498480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:36.498941 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:36.499360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:36.667091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.676630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-34e43b61-ee1b-4014-b952-855ff13369a9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.244363 Oct 04 14:30:36.681867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 55/125] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:36 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:36.782345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:36.801532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cfcc23a4-4bc6-47a3-8894-9c1aabdf2a86 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.315831 Oct 04 14:30:36.804016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 71/126] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:36 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:37.124589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:37.125813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:37.150441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.151665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.152435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.155469 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.156901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.157962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.184798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:37.185423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:37.199908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.200428 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.200863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.202720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.206285 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.209120 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.372735 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:37.389581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:37.392652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:37.395928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:37.400157 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e6a28058-02c9-46dd-a00f-a9ab68e8c274 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.280597 Oct 04 14:30:37.400879 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 56/127] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:37 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:37.402320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f0c4d30f-37ae-46c5-a2fc-f5aea5ef1090 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.229907 Oct 04 14:30:37.403438 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 72/128] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:37 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:37.453276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:37.453991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:37.481834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.482351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.488467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.489747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.490740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.491414 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.710289 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:37.713387 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:37.732282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.733036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.734649 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.735709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.738457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.741556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.760957 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:37.770964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-283bd996-e4f4-414c-95c0-a3d7bdf1b2f5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.322168 Oct 04 14:30:37.778870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 57/129] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:37 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:37.843738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:37.845230 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:37.857782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.858304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.858982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:37.859985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:37.861335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:37.861939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.072182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:38.090945 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2747f6f3-d499-48e9-802d-5fd1a774fb7f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.384197 Oct 04 14:30:38.094394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 73/130] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:37 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:38.100928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-5e0c427a-c83b-47a6-9f02-06e91cd80d44 req-cc695491-2233-40e5-a1c7-2d9da2dcecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92da7788-17c4-4129-b353-b25576213350", "name": "network-vif-plugged", "status": "completed", "tag": "3a45f381-06ca-4183-af22-7b3ce0bb06a4"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:38.154362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-5e0c427a-c83b-47a6-9f02-06e91cd80d44 req-cc695491-2233-40e5-a1c7-2d9da2dcecf5 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.155111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-5e0c427a-c83b-47a6-9f02-06e91cd80d44 req-cc695491-2233-40e5-a1c7-2d9da2dcecf5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.155881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-5e0c427a-c83b-47a6-9f02-06e91cd80d44 req-cc695491-2233-40e5-a1c7-2d9da2dcecf5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.178307 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-5e0c427a-c83b-47a6-9f02-06e91cd80d44 req-cc695491-2233-40e5-a1c7-2d9da2dcecf5 service nova] Creating event network-vif-plugged:3a45f381-06ca-4183-af22-7b3ce0bb06a4 for instance 92da7788-17c4-4129-b353-b25576213350 on hv-cinder-86026 Oct 04 14:30:38.185785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-5e0c427a-c83b-47a6-9f02-06e91cd80d44 req-cc695491-2233-40e5-a1c7-2d9da2dcecf5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089490 Oct 04 14:30:38.189505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 74/131] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:38.431944 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:38.433324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:38.456209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.457130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.458058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.460008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.461037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.461776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.507641 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:38.546781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e98103d5-722f-4c27-97f8-d383eacc205c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.702094 Oct 04 14:30:38.549791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 58/132] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:37 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:38.567106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:38.587609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:38.614083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.625318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.632211 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.639158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.642666 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.646981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.815357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:38.824891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d7c4355f-c973-4ac1-9406-12877324a3cb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.402924 Oct 04 14:30:38.830918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 75/133] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:38 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:38.841829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:38.842718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:38.859538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.859940 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.862857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:38.863894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:38.866477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:38.867148 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:39.074713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:39.085061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d5296f90-e886-4369-b400-5dd6f8cdac22 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.250440 Oct 04 14:30:39.085839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 76/134] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:38 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:39.122966 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:39.123928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:39.128433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:39.133418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:39.134172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:39.135005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:39.135922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:39.137298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:39.137927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:39.138949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:39.141516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:39.142937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-68402c3b-2ba9-4f1f-8c4f-1e86ea126b68 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.579593 Oct 04 14:30:39.145439 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 59/135] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:38 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:39.375313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:39.396006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b6b3fc76-a51e-40d8-8c66-c01c5278f24b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.280496 Oct 04 14:30:39.397395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 77/136] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:39 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:39.578002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:39.579529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:39.596068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:39.596771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:39.597216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:39.597941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:39.598399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:39.599888 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:39.811325 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:39.821976 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-240db66c-1550-47ac-a523-58cf0cf7a21a tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.250033 Oct 04 14:30:39.822892 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 60/137] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:39 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:39.861714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:39.862847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:39.869646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:39.870199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:39.871040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:39.872111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:39.872762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:39.873406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.098348 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:40.107588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-97a3b35a-cb61-4146-a62c-30371b71d0b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.249707 Oct 04 14:30:40.108172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 78/138] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:39 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:40.117978 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:40.118591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:40.125201 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.125686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.126120 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.126982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.127442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.127862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.180976 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:40.181661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:40.191201 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.191751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.192186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.195383 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.196541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.197786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.368027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:40.378888 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-83ab3a9d-033d-4c73-89a1-301c6b935c3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.270229 Oct 04 14:30:40.383089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 61/139] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:40 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:40.406639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-c318eae0-5cf4-41b6-9e46-9c427bb26393 req-74a595d9-2154-42e5-bddb-02d7e75ef8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd38da3-9e0e-426c-b4a2-9c582119f22f", "name": "network-vif-plugged", "status": "completed", "tag": "fdd48946-1df6-48c0-871f-7f58d52dcaba"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:40.432935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c318eae0-5cf4-41b6-9e46-9c427bb26393 req-74a595d9-2154-42e5-bddb-02d7e75ef8e4 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.433678 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c318eae0-5cf4-41b6-9e46-9c427bb26393 req-74a595d9-2154-42e5-bddb-02d7e75ef8e4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.434156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c318eae0-5cf4-41b6-9e46-9c427bb26393 req-74a595d9-2154-42e5-bddb-02d7e75ef8e4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.456474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-c318eae0-5cf4-41b6-9e46-9c427bb26393 req-74a595d9-2154-42e5-bddb-02d7e75ef8e4 service nova] Creating event network-vif-plugged:fdd48946-1df6-48c0-871f-7f58d52dcaba for instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f on hv-cinder-86026 Oct 04 14:30:40.468949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-c318eae0-5cf4-41b6-9e46-9c427bb26393 req-74a595d9-2154-42e5-bddb-02d7e75ef8e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082540 Oct 04 14:30:40.470847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 62/140] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:40.482857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:40.489030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:40.491329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:40.496867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:40.499298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.499989 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.500607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.501695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.502313 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.502884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.507779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:40.511687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:40.515062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bd9721dc-685a-418e-a67c-8d7a80084a12 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.339671 Oct 04 14:30:40.529457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 79/141] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:40 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:40.676140 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:40.688980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-68dd4a83-2443-4145-adcf-0a2c6f90971e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.215927 Oct 04 14:30:40.690334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 63/142] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:40 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:40.847857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:40.853357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:40.877952 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.879662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.880845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:40.881737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:40.882615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:40.883696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.139768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:41.153250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:41.186756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.187780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.188416 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.193283 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.194371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.201950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.211716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:41.250647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:41.262897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fb7a1660-e9bf-43f6-8dea-89cece287284 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.418910 Oct 04 14:30:41.275687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 80/143] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:40 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:41.442172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:41.444782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:41.465431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.466520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.467163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.472909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.475280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.475966 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.528510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:41.547685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-64145083-9fb4-4f8d-b604-2e19d0be25e9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.418604 Oct 04 14:30:41.549144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 64/144] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:41 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:41.595981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:41.600614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:41.696296 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.699791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.702382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.704113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.715320 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.720669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.787019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:41.800137 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-171722c6-7b29-4227-a80b-36d7565a83d7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1367 microversion: 2.1 time: 0.386630 Oct 04 14:30:41.801852 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 81/145] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:41 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:41.817611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:41.820062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:41.835724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.835724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.835724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:41.835724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:41.836022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:41.844682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.110451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:42.130349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:42.130349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:42.130349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e06fa5a6-3e7c-4d49-a5b5-5f066b7b74da tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.577002 Oct 04 14:30:42.130934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 65/146] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:41 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:42.133422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:42.149503 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c7f46ca5-93e4-4e9a-93a0-547269636d47 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.345124 Oct 04 14:30:42.150670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 82/147] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:41 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:42.293784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:42.295366 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:42.306995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.307961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.311456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.313310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.314460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.315323 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.476931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:42.486570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-28bc9e53-9e89-4a69-be1e-44ddd37c320c tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.201920 Oct 04 14:30:42.487631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 66/148] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:42 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:42.545188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "name": "network-vif-plugged", "status": "completed", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}, {"server_uuid": "a76166c5-baf9-4033-be8c-b138512c2fdc", "name": "network-vif-plugged", "status": "completed", "tag": "d9a62f08-f97c-4b57-912d-1b054d110489"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:42.557224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.557937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.558362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.573305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] Creating event network-vif-plugged:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:30:42.573463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:42.573937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:42.574283 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] Creating event network-vif-plugged:d9a62f08-f97c-4b57-912d-1b054d110489 for instance a76166c5-baf9-4033-be8c-b138512c2fdc on hv-cinder-86026 Oct 04 14:30:42.581543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-0e0828e1-fef4-4cd6-9669-ccf01c0619c3 req-be6aa6a8-4c48-46c0-9e63-ac63f47f3527 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040355 Oct 04 14:30:42.582384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 83/149] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:30:42.584302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.585282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.585748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.586629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.587076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.587678 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.792046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:42.802608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cad8297f-4891-47e0-bfec-a3d8855a1fce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.235219 Oct 04 14:30:42.803999 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 67/150] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:42 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:42.831216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:42.834522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:42.850052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.851463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.851915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:42.852990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:42.853672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:42.854285 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.042246 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:43.054353 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bb8ccf90-b6f9-43db-ad9a-fb20fe0525db tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1556 microversion: 2.1 time: 0.229321 Oct 04 14:30:43.055682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 84/151] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:42 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:43.102762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:43.103257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:43.117331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.117863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.124283 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.125075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.125570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.126014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.155599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:43.157499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:43.195516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.197249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.197716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.198460 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.198908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.202320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.362118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-db405d97-0172-448f-8937-f1b614587aa0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283425 Oct 04 14:30:43.364259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 68/152] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:30:43 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:43.370684 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:43.371436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:43.394312 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.394811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.395252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.396586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.397043 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.397470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.565018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:43.579031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:43.580759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:43.581931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d004a32c-26d7-424b-a160-a985348ee053 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.432732 Oct 04 14:30:43.589079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 85/153] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:43 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:30:43.596544 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:43.597477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:43.606361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.607102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.607775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.608614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.609433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.610036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.831566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:43.836701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:43.852962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e8e53a38-c45f-4c75-bd47-09ddceece701 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.262455 Oct 04 14:30:43.853731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 86/154] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:43 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:43.875173 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:43.876194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:43.883870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.884769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.885436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:43.886413 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:43.887087 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:43.887723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:44.092776 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:44.103366 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9cb7fa85-fcc5-4c71-ae71-7f513a2c2462 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.737569 Oct 04 14:30:44.103947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 69/155] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:43 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:44.142856 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:44.151404 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-06a998bd-32be-45f0-8823-a33f85f5919c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1321 microversion: 2.1 time: 0.285044 Oct 04 14:30:44.151992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 87/156] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:43 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:44.612012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:44.612650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:44.620197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:44.621226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:44.621863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:44.622857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:44.623752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:44.624363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:44.878781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:44.879439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:44.893748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:44.894947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:44.896023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:44.897034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:44.897724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:44.898960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:44.991777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.000387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.002333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.003993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6b2a74ef-ca0c-418e-9dbe-e4ac051caa37 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.397406 Oct 04 14:30:45.022470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 70/157] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:44 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:45.073259 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.085395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e2e095e2-373e-4918-8458-4d8749a830e3 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.210239 Oct 04 14:30:45.086000 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 88/158] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:44 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:45.128893 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:45.130898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:45.137501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.137991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.138426 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.139135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.139793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.140226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.174986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:45.175603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:45.184379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.184876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.185308 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.188668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.189196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.189632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.373086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.390994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4a871122-cf53-44d1-b512-01b806acec30 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1515 microversion: 2.1 time: 0.219767 Oct 04 14:30:45.391926 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 89/159] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:45 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:45.416050 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:45.418378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:45.421418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:45.425666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.426151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.426587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.427973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.428492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.429042 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.494980 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'flavor' on Instance uuid 0cd38da3-9e0e-426c-b4a2-9c582119f22f {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:30:45.637014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.653523 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-20c65836-e545-4e95-aa9b-34e40bb0bb45 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.529828 Oct 04 14:30:45.654532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 71/160] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:45 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:45.657416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c114a16d-2623-4c2a-99cc-238610fcaa3e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f/action" status: 200 len: 32 microversion: 2.1 time: 0.244858 Oct 04 14:30:45.658726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 90/161] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:30:45 2022] POST /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 14:30:45.660106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-cc2488dc-cca3-4b03-a825-29b6331de6d7 req-b5b00504-6919-4b6d-8365-f78aac6cb512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92da7788-17c4-4129-b353-b25576213350", "tag": "3a45f381-06ca-4183-af22-7b3ce0bb06a4"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:45.670974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-cc2488dc-cca3-4b03-a825-29b6331de6d7 req-b5b00504-6919-4b6d-8365-f78aac6cb512 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.671920 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-cc2488dc-cca3-4b03-a825-29b6331de6d7 req-b5b00504-6919-4b6d-8365-f78aac6cb512 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.672572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-cc2488dc-cca3-4b03-a825-29b6331de6d7 req-b5b00504-6919-4b6d-8365-f78aac6cb512 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.687377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-cc2488dc-cca3-4b03-a825-29b6331de6d7 req-b5b00504-6919-4b6d-8365-f78aac6cb512 service nova] Creating event network-changed:3a45f381-06ca-4183-af22-7b3ce0bb06a4 for instance 92da7788-17c4-4129-b353-b25576213350 on hv-cinder-86026 Oct 04 14:30:45.693296 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-cc2488dc-cca3-4b03-a825-29b6331de6d7 req-b5b00504-6919-4b6d-8365-f78aac6cb512 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037240 Oct 04 14:30:45.694123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 72/162] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:45.694742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:45.698453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:45.705034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.705520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.705944 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.706633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:45.707109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:45.707522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:45.905677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:45.918040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c2589e60-0a87-4cde-8d3b-55991fda3d4c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.238404 Oct 04 14:30:45.918636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 91/163] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:45 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:46.033077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:46.033789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:46.045065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.045495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.045942 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.046777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.047151 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.047584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.108897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:46.109520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:46.122084 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.122583 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.123018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.123736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.127260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.127848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.222435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:46.234827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:46.237291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:46.238617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-66d71cf8-7b33-41d6-b271-064fa504acb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.210205 Oct 04 14:30:46.240497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 73/164] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:46 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:46.366480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:46.373037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a01d33d2-d266-4c2f-98f5-b99a1fbd07f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.268297 Oct 04 14:30:46.374167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 92/165] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:46 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:46.685513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:46.686290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:46.693994 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.694572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.695012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.695740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.696198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.699630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.913218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:46.923006 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b3361d67-9660-48a8-812d-06b4376c8aca tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.243034 Oct 04 14:30:46.923853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 74/166] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:46 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:46.947963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:46.948886 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:46.956399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.957022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.957815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:46.959210 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:46.961390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:46.962230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:47.133649 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:47.148225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-745f8876-4c8c-4501-ac34-10d2c11fe288 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.204465 Oct 04 14:30:47.148225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 93/167] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:46 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:47.270206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:47.271432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:47.277736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:47.278239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:47.278689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:47.279399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:47.279859 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:47.280293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:47.398878 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:47.399658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:47.408065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:47.408846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:47.409897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:47.410240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:47.410902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:47.411408 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:47.427380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:47.436802 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:47.438302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:47.439432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-52e71b72-04dd-4de8-aa17-26d548a75c86 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.173306 Oct 04 14:30:47.440195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 75/168] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:47 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:47.743375 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:47.751325 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d6aafc55-2dae-4c92-a2f0-c8ccd53aa3de tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.357390 Oct 04 14:30:47.751899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 94/169] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:47 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:47.947611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:47.948217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:47.954320 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:47.954798 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:47.955228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:47.955916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:47.956389 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:47.956815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.108675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:48.117838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c0b089da-b6a0-4ec5-812c-23a60fe4fe4a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.174129 Oct 04 14:30:48.118442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 76/170] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:47 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:48.174418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:48.175331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:48.184265 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:48.184916 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:48.185354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.186060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:48.186517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:48.187159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.350850 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:48.359180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e5b97b56-56d8-4fb4-99a2-e4d1d0be4d9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.189318 Oct 04 14:30:48.359834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 95/171] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:48 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:48.466080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:48.466685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:48.473122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:48.473903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:48.474508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.475358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:48.475906 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:48.476410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.613052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:48.623097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:48.624575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:48.625691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bc230d47-3808-4605-8e5a-aaed6dd7772f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.163579 Oct 04 14:30:48.626247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 77/172] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:48 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:48.775853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:48.776381 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:48.782969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:48.783461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:48.783914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.784664 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:48.785109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:48.785535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:48.919077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:48.927344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-034b5ce6-3e48-4020-86ea-187106bb47ec tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1315 microversion: 2.1 time: 0.155007 Oct 04 14:30:48.927937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 96/173] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:48 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:49.142969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:49.143582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:49.149803 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.150289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.150729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.151427 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.152108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.152399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.299030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:49.309832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-efcd3906-f398-4f1f-81e2-c7c868b9e1ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.170670 Oct 04 14:30:49.310642 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 78/174] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:49 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:49.385547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:49.386177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:49.393184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.393804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.394251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.395137 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.396459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.397169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.610456 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:49.653179 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:49.653774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-15e70266-ff0e-4bbf-b9d0-116e3a2c042b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.274347 Oct 04 14:30:49.654360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 97/175] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:49 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:49.665422 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:49.692147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.692703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.696556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.698982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.702644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.703316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.883154 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:49.894399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:49.895908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:49.897212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0c5bf96c-5e21-41e1-ab03-e61eb3ea9eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1407 microversion: 2.20 time: 0.249218 Oct 04 14:30:49.897752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 79/176] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:49 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:30:49.950262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:49.950954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:49.957979 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.959236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.959686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:49.960750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:49.961311 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:49.961750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.189264 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:50.201802 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5c9b8566-1f64-49e6-a1b3-35539eabc196 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1503 microversion: 2.1 time: 0.255410 Oct 04 14:30:50.205027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 98/177] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:49 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:50.303648 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-afbe1246-b75f-4047-b0d2-49ba74326474 req-f516a482-bb47-47f7-8c51-f6a285ca73d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d55b4f-410d-4527-a9d3-15f1942a46d0", "name": "network-vif-plugged", "status": "completed", "tag": "4f9df3e5-1e5c-45b5-9628-2769911f67a4"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:50.320160 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-afbe1246-b75f-4047-b0d2-49ba74326474 req-f516a482-bb47-47f7-8c51-f6a285ca73d5 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.326615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-afbe1246-b75f-4047-b0d2-49ba74326474 req-f516a482-bb47-47f7-8c51-f6a285ca73d5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.329615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-afbe1246-b75f-4047-b0d2-49ba74326474 req-f516a482-bb47-47f7-8c51-f6a285ca73d5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.341537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:50.342441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:50.355333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-afbe1246-b75f-4047-b0d2-49ba74326474 req-f516a482-bb47-47f7-8c51-f6a285ca73d5 service nova] Creating event network-vif-plugged:4f9df3e5-1e5c-45b5-9628-2769911f67a4 for instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 on hv-cinder-86026 Oct 04 14:30:50.360442 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.363927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.366588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.367474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.368568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-afbe1246-b75f-4047-b0d2-49ba74326474 req-f516a482-bb47-47f7-8c51-f6a285ca73d5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068640 Oct 04 14:30:50.368737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.369167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.377314 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 80/178] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:50.674658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:50.682379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:50.683246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:50.695297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.695824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.696597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.697547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.698006 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.698612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.700749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ae2bfaa5-65b6-4e6a-9e21-72e4fdd87eb7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.369882 Oct 04 14:30:50.702791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 99/179] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:50 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:50.930714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:50.931399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:50.951883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.952471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.955828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:50.972686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:50.972686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:50.972686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:51.164369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:51.229799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bbf9c0a8-3242-4e9d-8226-a9c678cef633 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.547947 Oct 04 14:30:51.241459 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 81/180] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:50 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:51.324615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:51.343556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:51.354804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:51.359632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bb2bc3ad-3908-40fe-9536-a9a5eb39f11e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1599 microversion: 2.20 time: 0.434162 Oct 04 14:30:51.360963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 100/181] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:30:50 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1599 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:30:51.390334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:51.391024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:51.399695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:51.399980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:51.400635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:51.401550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:51.402186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:51.402880 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:51.420493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:51.551679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-85af4367-fa9d-46bf-b6b3-3f2b231810c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165982 Oct 04 14:30:51.552652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 82/182] 10.222.0.64 () {60 vars in 1316 bytes} [Tue Oct 4 14:30:51 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:30:51.734417 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:51.736294 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:51.748017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:51.749937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:51.751808 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:51.753481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:51.755934 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:51.757630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:51.798539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:30:51.922345 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc1797e-080c-4c7a-9ec2-7388269a032a"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:51.938275 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:51.951157 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:51.952029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:51.952830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:51.953905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:51.955625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:51.956472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:52.095209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:52.119250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4b26179a-708c-42e0-bcd2-e397133d0693 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1364 microversion: 2.1 time: 0.391265 Oct 04 14:30:52.139827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 101/183] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:51 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1364 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:52.277896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:52.278711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:52.285682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:52.287298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:52.287980 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:52.289236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:52.289815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:52.290228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:52.681066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:52.684281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-70ff573e-51b5-47e3-9247-3bbe044aedc2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "POST /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767991 Oct 04 14:30:52.685845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 83/184] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:30:51 2022] POST /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:30:52.700964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ff2a2c41-27fb-4107-b987-cf610afd3d09 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.426928 Oct 04 14:30:52.701567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 102/185] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:52 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:53.169351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:53.173401 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:53.188177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.189644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.190125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.191359 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.191916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.194832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.441116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:53.451879 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-819ac386-1e91-4159-ae32-05f45bb6a9ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1549 microversion: 2.1 time: 0.291315 Oct 04 14:30:53.454370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 84/186] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:53 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1549 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:53.481855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:53.483102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:53.492584 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.493064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.493720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.494514 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.495094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.495536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.660355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-308e88a0-2606-4d91-82e7-c4b5f3b34669 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183637 Oct 04 14:30:53.662080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 103/187] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:30:53 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:30:53.733834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:53.735197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:53.744109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.745038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.745823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.746956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.747663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.748338 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.792724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-e091a331-a1d5-45a8-92a6-341d5dcfd90d req-d750fe6c-75f3-47f5-8f14-c24aec0ed034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:53.831229 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e091a331-a1d5-45a8-92a6-341d5dcfd90d req-d750fe6c-75f3-47f5-8f14-c24aec0ed034 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:53.837965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e091a331-a1d5-45a8-92a6-341d5dcfd90d req-d750fe6c-75f3-47f5-8f14-c24aec0ed034 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:53.838691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e091a331-a1d5-45a8-92a6-341d5dcfd90d req-d750fe6c-75f3-47f5-8f14-c24aec0ed034 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:53.857144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-e091a331-a1d5-45a8-92a6-341d5dcfd90d req-d750fe6c-75f3-47f5-8f14-c24aec0ed034 service nova] Creating event network-changed:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:30:53.866538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-e091a331-a1d5-45a8-92a6-341d5dcfd90d req-d750fe6c-75f3-47f5-8f14-c24aec0ed034 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077744 Oct 04 14:30:53.868841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 104/188] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:30:54.127962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:54.138432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-05b343b5-4396-495d-bee1-986c546cd76a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.409216 Oct 04 14:30:54.139038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 85/189] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:53 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:55.165713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:55.167163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:55.174279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:55.175183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:55.175932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:55.177791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:55.178513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:55.179863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:55.576939 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:55.587298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4bfe97ba-311b-416e-8aac-197d0cedb716 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.425810 Oct 04 14:30:55.588964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 105/190] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:55 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:56.055028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-42297127-f23c-4a56-b6d0-c34ac4d92917 req-637f7e4e-0bb8-4852-8ba1-a34d130ccb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d55b4f-410d-4527-a9d3-15f1942a46d0", "tag": "4f9df3e5-1e5c-45b5-9628-2769911f67a4"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:56.069984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-42297127-f23c-4a56-b6d0-c34ac4d92917 req-637f7e4e-0bb8-4852-8ba1-a34d130ccb56 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:56.070740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-42297127-f23c-4a56-b6d0-c34ac4d92917 req-637f7e4e-0bb8-4852-8ba1-a34d130ccb56 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:56.071327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-42297127-f23c-4a56-b6d0-c34ac4d92917 req-637f7e4e-0bb8-4852-8ba1-a34d130ccb56 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:56.097708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-42297127-f23c-4a56-b6d0-c34ac4d92917 req-637f7e4e-0bb8-4852-8ba1-a34d130ccb56 service nova] Creating event network-changed:4f9df3e5-1e5c-45b5-9628-2769911f67a4 for instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 on hv-cinder-86026 Oct 04 14:30:56.112812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-42297127-f23c-4a56-b6d0-c34ac4d92917 req-637f7e4e-0bb8-4852-8ba1-a34d130ccb56 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058086 Oct 04 14:30:56.114018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 86/191] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:30:56.611474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:56.613048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:56.625153 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:56.626420 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:56.628642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:56.629744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:56.633118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:56.633967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:56.893417 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:56.904701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-325b94a2-9233-48f9-a89c-e0d72f9d44d1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.297044 Oct 04 14:30:56.905729 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 106/192] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:56 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:30:57.934080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:57.934788 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:57.942858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:57.943590 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:57.944033 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:57.944784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:57.945246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:57.945678 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:58.101280 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:58.109941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cb5da4ce-024e-4085-898a-92cba8d7eca3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.180626 Oct 04 14:30:58.110535 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 87/193] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:57 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:58.450109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-851157863", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "networks": [{"uuid": "470e3fa5-8495-498c-bd2a-466c324e9bda"}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:30:58.531144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] validate_networks() for [('470e3fa5-8495-498c-bd2a-466c324e9bda', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:30:59.109040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:30:59.109490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:30:59.109962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:30:59.110433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:30:59.110844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:30:59.120727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:59.121203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:59.121633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:59.122355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:59.122805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:59.123226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:59.134733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:59.135922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:59.140290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Getting quotas for project ff877a220f9443fb93fde985a653c999. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:30:59.142461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:59.142943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:59.143376 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:59.144067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:30:59.144195 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Getting quotas for user b3bd51e1acb548ea957ffb57cb09f3f4 and project ff877a220f9443fb93fde985a653c999. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:30:59.144552 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:30:59.144977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:30:59.155627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:30:59.158390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:30:59.207942 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e8991230-3979-41cc-8d1e-bf0f32df3b8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761839 Oct 04 14:30:59.208796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 107/194] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:30:59.219457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a1d110d1-a034-4abc-b5ae-d043514b693e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:30:59.220070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a1d110d1-a034-4abc-b5ae-d043514b693e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:30:59.279151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a1d110d1-a034-4abc-b5ae-d043514b693e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:59.289919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a1d110d1-a034-4abc-b5ae-d043514b693e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1213 microversion: 2.1 time: 0.074139 Oct 04 14:30:59.290627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 108/195] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:59 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:30:59.306418 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:30:59.315247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-59637b6c-579f-4ef6-a35b-664c9f6cda63 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.184613 Oct 04 14:30:59.316185 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 88/196] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:30:59 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:00.317462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:00.318199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:00.324559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:00.325049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:00.325483 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:00.326184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:00.326642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:00.327065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:00.340620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:00.341232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:00.350686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:00.351172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:00.351611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:00.352333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:00.352838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:00.353347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:00.393134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:00.402040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-51928cb2-e921-4f6e-bad4-265eb6273bca tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.089061 Oct 04 14:31:00.402722 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 109/197] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:00 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:00.491250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:00.499070 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9be9ed66-180e-4b48-ae7a-0b9e02307ee2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.162709 Oct 04 14:31:00.499641 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 89/198] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:00 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:01.428199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:01.429205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:01.437820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:01.438867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:01.439619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:01.440954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:01.441612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:01.443154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:01.505841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:01.513439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-6a1097e6-f338-4b6a-93f1-9e29511cedd3 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.090372 Oct 04 14:31:01.513997 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 110/199] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:01 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:01.522568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:01.523171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:01.529823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:01.530309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:01.530744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:01.531438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:01.531922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:01.532337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:01.671248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:01.680801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bbaadbb2-0f22-4470-add1-19c5110578f9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.162240 Oct 04 14:31:01.681467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 90/200] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:01 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:02.536835 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:02.537368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:02.543306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:02.543788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:02.544247 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:02.544963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:02.545416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:02.545844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:02.606887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:02.614755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4a7f0aff-7577-439d-a266-97146ffd3c30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.082300 Oct 04 14:31:02.615322 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 111/201] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:02 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:02.708590 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:02.709235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:02.715721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:02.716209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:02.716693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:02.717425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:02.717881 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:02.718396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:02.847193 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:02.855637 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e8790167-6e32-41a0-b193-dc885e9b7e92 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.151056 Oct 04 14:31:02.856220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 91/202] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:02 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:03.637935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:03.638548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:03.645355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:03.646029 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:03.646469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:03.647172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:03.647624 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:03.648049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:03.713325 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:03.727581 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7605d1cb-d25d-48ff-99c2-5708b3b50aa6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.093119 Oct 04 14:31:03.728698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 112/203] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:03 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:03.878813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:03.879629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:03.886724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:03.887204 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:03.887634 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:03.888350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:03.888792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:03.889212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:04.032143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:04.040893 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c3e3ccd8-3f9a-47ae-ac17-c005dc2ea06b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.165879 Oct 04 14:31:04.041476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 92/204] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:03 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:04.753507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:04.754031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:04.760921 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:04.761409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:04.761840 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:04.762543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:04.762993 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:04.763410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:04.829910 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:04.837953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3cacb6a6-0f35-4248-9dcd-da2e2a92d067 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.088363 Oct 04 14:31:04.838529 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 113/205] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:04 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:05.063859 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:05.064396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:05.070781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:05.071261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:05.071688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:05.072387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:05.072833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:05.073274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:05.413623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:05.421226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2f49f472-1704-4c93-aab6-15233987891f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.361256 Oct 04 14:31:05.421793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 93/206] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:05 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:05.861079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:05.861781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:05.869406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:05.869976 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:05.870422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:05.871198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:05.871675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:05.872101 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:05.937495 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:05.947461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2dada896-fb84-4bbd-be90-a878c5c7fe29 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.090455 Oct 04 14:31:05.948191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 114/207] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:05 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:06.444444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:06.445097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:06.451618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:06.452101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:06.452564 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:06.453271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:06.453721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:06.454142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:06.584998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:06.593204 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a08e693e-746c-4246-8e0d-7e75c830f7be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.152994 Oct 04 14:31:06.593779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 94/208] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:06 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:06.972967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:06.974107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:06.980011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:06.980535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:06.980999 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:06.981699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:06.982151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:06.982569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:07.048718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:07.057253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fbb78121-2fe9-4c26-ade8-1d91efb13a22 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.088797 Oct 04 14:31:07.058502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 115/209] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:06 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:07.621191 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:07.622378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:07.637500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:07.638127 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:07.638843 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:07.640037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:07.640895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:07.641662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:07.825379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:07.833870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ecb0416d-c60a-42b9-b192-d178e62f141e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.220529 Oct 04 14:31:07.834369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 95/210] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:07 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:08.085161 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:08.086405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:08.093341 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:08.093833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:08.094284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:08.094964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:08.095409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:08.095824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:08.203064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:08.220679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d040e3bb-8f4c-443c-951c-e03c65f43129 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1265 microversion: 2.1 time: 0.139526 Oct 04 14:31:08.221761 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 116/211] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:08 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:08.857769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:08.858348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:08.866124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:08.866670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:08.867294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:08.868028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:08.868536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:08.868959 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.143424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:09.158689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:09.160274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:09.164243 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b0babcf4-f38d-4f35-80c0-977e7ab82e1d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.309586 Oct 04 14:31:09.164895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 96/212] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:08 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:09.168473 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:09.170662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:09.171395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:09.172060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.172931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:09.173463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:09.174016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.203488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:31:09.250161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:09.251035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:09.262892 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:09.264302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:09.265494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.266974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:09.267930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:09.268849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.288596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=8 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:09.323077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8169731d-ccd0-43e2-a20e-a0e9ee799c67 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 204 len: 0 microversion: 2.1 time: 0.168053 Oct 04 14:31:09.327922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 117/213] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:31:09 2022] DELETE /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:31:09.333953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:09.334675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:09.340897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:09.341388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:09.341818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.342535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:09.342988 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:09.343401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:09.400917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:09.409071 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5b597282-96b3-4998-a11d-aec679b4cae9 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1271 microversion: 2.1 time: 0.166502 Oct 04 14:31:09.409670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 97/214] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:09 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:09.500033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:09.510272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-df60bb31-5f84-435a-9192-ba8b16502121 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1555 microversion: 2.1 time: 0.180710 Oct 04 14:31:09.511067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 118/215] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:09 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:10.191289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:10.192035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:10.198869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:10.199379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:10.199828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:10.200635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:10.201267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:10.201696 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:10.342265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:10.344853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:10.353569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7f820c6b-ecbe-46c4-96af-ffe6c660bc0d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.166203 Oct 04 14:31:10.354341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 98/216] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:10 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:10.435282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:10.437087 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:10.448986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:10.449517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:10.450282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:10.451102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:10.451560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:10.451982 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:10.468819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:10.534688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:10.535480 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:10.537510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=72 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:10.544233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:10.544929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:10.545553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:10.546272 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:10.546729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:10.547158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:10.691058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:10.700422 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2743eae8-d942-4fc2-a4b8-2ae80315a3cb tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1555 microversion: 2.1 time: 0.170450 Oct 04 14:31:10.701591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 99/217] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:10 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:10.727820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:10.737492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0101e56b-ed73-43a9-93f5-a35e9bc088bb tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.307832 Oct 04 14:31:10.739180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 119/218] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:10 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:11.377620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:11.378228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:11.385794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:11.386716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:11.387216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:11.388017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:11.388581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:11.389094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:11.725927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:11.727191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:11.733779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:11.734741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:11.735347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:11.736227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:11.736917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:11.737542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:11.798682 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:11.809758 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-01446cb1-824d-431d-807e-f2101dd43060 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.434599 Oct 04 14:31:11.813227 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 100/219] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:11 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:11.818902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:11.820807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:11.844387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:11.844901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:11.845338 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:11.849209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:11.850917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:11.853956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:11.962813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:11.975009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-01ff5ff0-e97c-4a83-8d05-1038a04f97dd tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1555 microversion: 2.1 time: 0.253371 Oct 04 14:31:11.985396 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 120/220] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:11 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:12.342191 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:12.350989 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3e5b41c4-870f-4105-8a29-5b42fe3e82c6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.536089 Oct 04 14:31:12.351884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 101/221] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:11 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:12.840292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:12.841071 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:12.851196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:12.852187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:12.852859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:12.854930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:12.855568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:12.856151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:13.002597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:13.003327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:13.017010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:13.018158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:13.019453 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:13.022926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:13.023556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:13.024114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:13.084613 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:13.097269 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b6370b8c-b782-4555-888e-71b61c9e2f40 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.262805 Oct 04 14:31:13.098670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 121/222] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:12 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:13.381335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:13.382246 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:13.389469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:13.390228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:13.390833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:13.391705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:13.393015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:13.393615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:13.511361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:13.525442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a9f1a21e-274a-4cd0-9f4e-274b2a58aeac tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1555 microversion: 2.1 time: 0.527229 Oct 04 14:31:13.526596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 102/223] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:12 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1555 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:13.655090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:13.671751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7f0c1f2b-a5f7-452b-bc0b-7b307f30bab5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.298051 Oct 04 14:31:13.672695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 122/224] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:13 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:13.870901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-baa1466e-4d2a-4094-b4e3-1c1cb5597a2b req-db3b3b24-fff8-4e5d-8247-06473eb5bdcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0417f02f-287b-46b4-871d-cf1cb2faf0ca", "tag": "0f7c29e1-34b4-4751-9b4d-bf4f577cecc7"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:13.896143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-baa1466e-4d2a-4094-b4e3-1c1cb5597a2b req-db3b3b24-fff8-4e5d-8247-06473eb5bdcf service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:13.897630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-baa1466e-4d2a-4094-b4e3-1c1cb5597a2b req-db3b3b24-fff8-4e5d-8247-06473eb5bdcf service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:13.898291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-baa1466e-4d2a-4094-b4e3-1c1cb5597a2b req-db3b3b24-fff8-4e5d-8247-06473eb5bdcf service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:13.928608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-baa1466e-4d2a-4094-b4e3-1c1cb5597a2b req-db3b3b24-fff8-4e5d-8247-06473eb5bdcf service nova] Creating event network-changed:0f7c29e1-34b4-4751-9b4d-bf4f577cecc7 for instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca on hv-cinder-86026 Oct 04 14:31:13.936167 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-baa1466e-4d2a-4094-b4e3-1c1cb5597a2b req-db3b3b24-fff8-4e5d-8247-06473eb5bdcf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072551 Oct 04 14:31:13.937603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 103/225] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:14.122674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:14.123734 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:14.139838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:14.140363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:14.140791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:14.141497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:14.141966 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:14.142375 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:14.474065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:14.486023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-66d53b41-8b50-4a5c-939b-15491ab0037e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.367157 Oct 04 14:31:14.502922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 123/226] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:14 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:14.555195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:14.555834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:14.563752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:14.564872 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:14.565374 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:14.566102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:14.567172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:14.568262 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:14.695813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:14.696702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:14.697326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:14.703882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:14.704390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:14.705562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:14.706357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:14.707486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:14.707914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:14.710002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-74c65c4a-8092-4536-b216-3b1991b5ab90 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1346 microversion: 2.1 time: 0.162921 Oct 04 14:31:14.712180 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 104/227] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:14 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:14.924824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:14.936455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-6826e85e-c094-43f0-8375-0ee588e791ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.244971 Oct 04 14:31:14.948340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 124/228] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:14 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:15.512375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:15.513012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:15.520259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.520780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.521224 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:15.521953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.522412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.522836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:15.735739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:15.736728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:15.738929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:15.752718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.753218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.753653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:15.755123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.755593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.756022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:15.830125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.830522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.830956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:15.831402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lazy-loading 'fault' on Instance uuid a76166c5-baf9-4033-be8c-b138512c2fdc {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:15.921723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:15.938306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b29c60b4-a1ac-4c49-92ab-4aecbb082ee2 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1351 microversion: 2.1 time: 0.206818 Oct 04 14:31:15.939226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 125/229] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:15 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:15.961871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:15.962772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:15.970084 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.970577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.971012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:15.971706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:15.972163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:15.974760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:16.090274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:16.100664 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-45b31573-9546-4921-9eab-df72274beec5 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.593256 Oct 04 14:31:16.108326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 105/230] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:15 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:16.125570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-4f43141f-c756-4c3b-ab2f-ff5ca4ea0123 req-6ca02dcc-6716-4554-957e-512c61f52b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76166c5-baf9-4033-be8c-b138512c2fdc", "name": "network-vif-deleted", "tag": "d9a62f08-f97c-4b57-912d-1b054d110489"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:16.154411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-4f43141f-c756-4c3b-ab2f-ff5ca4ea0123 req-6ca02dcc-6716-4554-957e-512c61f52b1f service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:16.155805 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-4f43141f-c756-4c3b-ab2f-ff5ca4ea0123 req-6ca02dcc-6716-4554-957e-512c61f52b1f service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:16.158182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-4f43141f-c756-4c3b-ab2f-ff5ca4ea0123 req-6ca02dcc-6716-4554-957e-512c61f52b1f service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:16.201199 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-4f43141f-c756-4c3b-ab2f-ff5ca4ea0123 req-6ca02dcc-6716-4554-957e-512c61f52b1f service nova] Creating event network-vif-deleted:d9a62f08-f97c-4b57-912d-1b054d110489 for instance a76166c5-baf9-4033-be8c-b138512c2fdc on hv-cinder-86026 Oct 04 14:31:16.212954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-4f43141f-c756-4c3b-ab2f-ff5ca4ea0123 req-6ca02dcc-6716-4554-957e-512c61f52b1f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101648 Oct 04 14:31:16.214670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 106/231] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:16.349017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:16.359185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-53a71207-0f3d-4abe-9357-f54bb70b38f8 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.400882 Oct 04 14:31:16.361867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 126/232] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:15 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:16.967750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:16.969011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:16.985007 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:16.989202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:16.989752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:16.990544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:16.991181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:16.991761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:17.069755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:17.070251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:17.078694 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:17.079327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lazy-loading 'fault' on Instance uuid a76166c5-baf9-4033-be8c-b138512c2fdc {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:17.147957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:17.150880 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:17.163698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:17.164728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:17.166303 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:17.167383 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:17.168919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:17.169602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:17.275699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6d20541ee8417ba718190c88c48deb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da10281be41c43988e60ecfafd5d0d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:17.291092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7f3be641-4012-4e66-b687-04632983b82b tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 200 len: 1305 microversion: 2.1 time: 0.329153 Oct 04 14:31:17.292064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 107/233] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:16 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 1305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:17.384340 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:17.384987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:17.393044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:17.393529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:17.393992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:17.395472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:17.396261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:17.396728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:17.536765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:17.575933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aea3f221-bc6f-40ec-8e01-f62f9818b8f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.437945 Oct 04 14:31:17.577811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 127/234] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:17 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:17.643768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:17.653553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-91f2e772-e5bd-46c2-9872-3832992bbae6 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.274416 Oct 04 14:31:17.654420 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 108/235] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:17 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:18.331740 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:18.334188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:18.343186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.343979 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.344671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.346116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.347251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.348666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.373648 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] HTTP exception thrown: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Request method failure captured: Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc HTTP/1.1 Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENknbQhuhQzKs9NXr5w6z5KJsX8ZKdp7L8A91d1xbzwWirA56yZjLtoCDEyoJB9RDzYjebmbWO-xWKLjxvLZseFqPUp-mhCdD4rV88qc6nbZJa0-xBcx2kpBqPZqz46kM8Ii7hTlTezAeIhN_2YxkNrSptryzGmvpnSOD8yuuZWPoI Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:31:18.396146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da10281be41c43988e60ecfafd5d0d12", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 3f6d20541ee8417ba718190c88c48deb Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.398810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'a76166c5-baf9-4033-be8c-b138512c2fdc'} Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:31:18.400126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.404637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.408537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Returning 404 to user: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:31:18.408537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d8c74110-a92c-41f8-9687-29b1a9bdb7f6 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 404 len: 111 microversion: 2.1 time: 0.072255 Oct 04 14:31:18.408537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 128/236] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:18 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:18.605147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:18.605884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:18.617567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.617567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.618169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.623628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.624241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.624727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.687981 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:18.688633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:18.698699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.699061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.704001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.704001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.704001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.704001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.850322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:18.865362 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-106a29ff-c4ab-48e6-b8c4-a669e178d83d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.264195 Oct 04 14:31:18.866408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 109/237] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:18 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:18.883556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:18.885946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:18.899073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.899984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.900847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.902264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:18.903125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:18.903926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:18.904761 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:18.914426 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1e427760-b510-4eef-84d7-7055ab2a951e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.233913 Oct 04 14:31:18.915022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 129/238] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:18 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:18.931037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] HTTP exception thrown: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Request method failure captured: Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc/os-volume_attachments HTTP/1.1 Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENknbQhuhQzKs9NXr5w6z5KJsX8ZKdp7L8A91d1xbzwWirA56yZjLtoCDEyoJB9RDzYjebmbWO-xWKLjxvLZseFqPUp-mhCdD4rV88qc6nbZJa0-xBcx2kpBqPZqz46kM8Ii7hTlTezAeIhN_2YxkNrSptryzGmvpnSOD8yuuZWPoI Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:31:18.943415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da10281be41c43988e60ecfafd5d0d12", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 3f6d20541ee8417ba718190c88c48deb Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.945408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'server_id': 'a76166c5-baf9-4033-be8c-b138512c2fdc'} Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:31:18.946356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:18.953935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:31:18.956013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Returning 404 to user: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:31:18.956013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8327e00a-d1b9-4556-850e-c09170b3af35 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077809 Oct 04 14:31:18.956013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 110/239] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:31:18 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:19.889615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:19.890501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:19.899358 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:19.900605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:19.901409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:19.902524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:19.908579 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:19.909224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:19.954863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:19.961306 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:20.014098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:20.014590 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:20.015016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:20.015713 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:20.016168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:20.016610 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:20.179585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:20.210193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7812dfe6-3ddb-4555-ba7b-c72ed6be8ef7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.324493 Oct 04 14:31:20.211221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 130/240] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:19 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:20.323773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:20.324868 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:20.333080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:20.333894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:20.334714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:20.335876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:20.336738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:20.337468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:20.356210 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] HTTP exception thrown: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Request method failure captured: Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: DELETE /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc HTTP/1.1 Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENknbQhuhQzKs9NXr5w6z5KJsX8ZKdp7L8A91d1xbzwWirA56yZjLtoCDEyoJB9RDzYjebmbWO-xWKLjxvLZseFqPUp-mhCdD4rV88qc6nbZJa0-xBcx2kpBqPZqz46kM8Ii7hTlTezAeIhN_2YxkNrSptryzGmvpnSOD8yuuZWPoI Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:31:20.357817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da10281be41c43988e60ecfafd5d0d12", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 3f6d20541ee8417ba718190c88c48deb Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.360096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'a76166c5-baf9-4033-be8c-b138512c2fdc'} Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:31:20.361403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.367513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.370577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Returning 404 to user: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:31:20.370577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0615ff6e-ba6b-46a4-a538-17d153156f13 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 404 len: 111 microversion: 2.1 time: 0.039719 Oct 04 14:31:20.370577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 131/241] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:31:20 2022] DELETE /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 14:31:20.382418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:20.383041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] [instance: a76166c5-baf9-4033-be8c-b138512c2fdc] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:20.391899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:20.392615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:20.393043 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:20.393750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:20.394201 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:20.395411 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:20.412419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] HTTP exception thrown: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Request method failure captured: Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc HTTP/1.1 Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENknbQhuhQzKs9NXr5w6z5KJsX8ZKdp7L8A91d1xbzwWirA56yZjLtoCDEyoJB9RDzYjebmbWO-xWKLjxvLZseFqPUp-mhCdD4rV88qc6nbZJa0-xBcx2kpBqPZqz46kM8Ii7hTlTezAeIhN_2YxkNrSptryzGmvpnSOD8yuuZWPoI Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:31:20.413983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da10281be41c43988e60ecfafd5d0d12", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da10281be41c43988e60ecfafd5d0d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: da10281be41c43988e60ecfafd5d0d12 Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918350237 Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 3f6d20541ee8417ba718190c88c48deb Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-DeleteServersTestJSON-1918350237-project Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.417136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'a76166c5-baf9-4033-be8c-b138512c2fdc'} Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:31:20.418710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. Oct 04 14:31:20.421580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:20.424634 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] Returning 404 to user: Instance a76166c5-baf9-4033-be8c-b138512c2fdc could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:31:20.424634 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2dc67ee7-0d42-4663-89c2-f29d60b37600 tempest-DeleteServersTestJSON-1918350237 tempest-DeleteServersTestJSON-1918350237-project] 10.222.0.64 "GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc" status: 404 len: 111 microversion: 2.1 time: 0.039891 Oct 04 14:31:20.424634 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 132/242] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:20 2022] GET /compute/v2.1/servers/a76166c5-baf9-4033-be8c-b138512c2fdc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:20.439210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:20.465204 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-008f6131-ed80-415a-b10e-ac4d4d02c922 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.529084 Oct 04 14:31:20.465947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 111/243] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:19 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:21.030539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-056d15ce-5310-4802-8d1f-79d41b0e1836 req-058d9de0-b043-4cf6-b402-2aba7057b627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0417f02f-287b-46b4-871d-cf1cb2faf0ca", "name": "network-vif-plugged", "status": "completed", "tag": "0f7c29e1-34b4-4751-9b4d-bf4f577cecc7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:21.041912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-056d15ce-5310-4802-8d1f-79d41b0e1836 req-058d9de0-b043-4cf6-b402-2aba7057b627 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:21.042744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-056d15ce-5310-4802-8d1f-79d41b0e1836 req-058d9de0-b043-4cf6-b402-2aba7057b627 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:21.043379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-056d15ce-5310-4802-8d1f-79d41b0e1836 req-058d9de0-b043-4cf6-b402-2aba7057b627 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:21.066925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-056d15ce-5310-4802-8d1f-79d41b0e1836 req-058d9de0-b043-4cf6-b402-2aba7057b627 service nova] Creating event network-vif-plugged:0f7c29e1-34b4-4751-9b4d-bf4f577cecc7 for instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca on hv-cinder-86026 Oct 04 14:31:21.078391 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-056d15ce-5310-4802-8d1f-79d41b0e1836 req-058d9de0-b043-4cf6-b402-2aba7057b627 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051328 Oct 04 14:31:21.084497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 133/244] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:21.240166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:21.241911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:21.253560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:21.254563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:21.264370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:21.265346 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:21.265984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:21.266588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:21.496134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:21.497232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:21.508959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:21.510089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:21.510914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:21.512604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:21.513433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:21.514124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:21.791728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:21.805469 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0d041eb1-82ef-4864-85d1-00630e7a17d4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.570207 Oct 04 14:31:21.808852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 112/245] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:21 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:21.946642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:21.963574 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e288e535-0461-47f5-84b8-eeb3e99af5de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.476317 Oct 04 14:31:21.965129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 134/246] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:21 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:22.843027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:22.843643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:22.860918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:22.862138 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:22.862769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:22.864974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:22.868556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:22.869307 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:22.991136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:23.006526 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:23.023838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:23.024755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:23.025597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:23.027393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:23.028146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:23.028861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:23.419716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:23.458089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-98487b61-2ce4-4547-a257-f00dec621666 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1313 microversion: 2.1 time: 0.469894 Oct 04 14:31:23.464926 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 135/247] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:22 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:24.074627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:24.103886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2c549b1d-4b4b-4609-9531-965dd2c16ca8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 1.265083 Oct 04 14:31:24.105367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 113/248] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:22 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:24.508866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:24.530293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:24.550164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:24.552124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:24.554354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:24.555396 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:24.556891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:24.557558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:24.975972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:24.986882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1e7dbd28-94c7-49a7-805b-78606521e5f7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1497 microversion: 2.1 time: 0.488787 Oct 04 14:31:24.990258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 136/249] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:24 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1497 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:25.129743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:25.131284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:25.145365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:25.148016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:25.148556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:25.154574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:25.156861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:25.162953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:25.765986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:25.777592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5344abf8-b4cc-43c2-adc3-0851dd62dbac tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.653507 Oct 04 14:31:25.778103 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 114/250] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:25 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:26.089637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:26.090674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:26.105907 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:26.108668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:26.109463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:26.113508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:26.114039 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:26.114445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:26.171072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:31:26.220785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:26.288292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ac8b074b-3605-43d5-b900-72275d4755de tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 204 len: 0 microversion: 2.1 time: 0.204056 Oct 04 14:31:26.289003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 137/251] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:31:26 2022] DELETE /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:31:26.313079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:26.316246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:26.369310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:26.373303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:26.374689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:26.376553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:26.394953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:26.395760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:26.760839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:26.788947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-62331cbb-ba00-4490-aa9f-f0b1bdba0e59 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1503 microversion: 2.1 time: 0.495198 Oct 04 14:31:26.790580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 115/252] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:26 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1503 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:26.813845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:26.814930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:26.844034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:26.844577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:26.845021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:26.846353 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:26.846353 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:26.846768 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:27.496726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:27.521914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3a957626-214a-4e00-be9a-aaeea6bdfd71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.723767 Oct 04 14:31:27.526816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 138/253] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:26 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:27.822535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:27.823509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:27.834171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:27.834860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:27.835767 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:27.836215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:27.836730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:27.837139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:28.082712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-59224dc7-e5fa-4d7d-af17-f1487648dc23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Action: 'create', calling method: .version_select at 0x7f57188a1790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1694566594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsovbEUnHETlmW2qJ/vXbUDKnvppBNmaK5iF51jS9Hk/M3mzGaJssJO5p0EKeTsFKBSVdGkoYPGZBizlEWQ1kWNAWBMjeZoHSugBHjbmGLyKuRO9Zlw/NKutwOLCvW6uQ=="}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:28.121290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:28.131725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0975c2ca-b7e5-4d74-80f2-5e5f2be27973 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1503 microversion: 2.1 time: 0.315762 Oct 04 14:31:28.132368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 139/254] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:27 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:28.132728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-59224dc7-e5fa-4d7d-af17-f1487648dc23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for project 408b16a582484c619ff17416990d5feb. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:31:28.138644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-59224dc7-e5fa-4d7d-af17-f1487648dc23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for user c7028d2ccede4b44b567387bb83c4579 and project 408b16a582484c619ff17416990d5feb. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:31:28.171372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-59224dc7-e5fa-4d7d-af17-f1487648dc23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.483746 Oct 04 14:31:28.172383 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 116/255] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:31:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:28.553490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:28.554354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:28.566927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:28.567756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:28.568212 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:28.569061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:28.573448 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:28.574467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:29.014937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:29.027883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5bd3424f-d9a4-4d4b-b253-f7055fad99ca tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1521 microversion: 2.1 time: 0.479888 Oct 04 14:31:29.030694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 140/256] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:28 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:29.163864 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:29.165031 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:29.199201 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:29.205854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:29.208048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:29.210304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:29.211620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:29.212466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:29.665165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:29.694113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6424ae36-ce81-4715-97b6-66c1ffcaecdd tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1503 microversion: 2.1 time: 0.541298 Oct 04 14:31:29.695883 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 117/257] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:29 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1503 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:30.058255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:30.059473 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:30.073355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.075530 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.076174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.080675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.081386 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.083998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.427466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:30.446150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e77c8ea8-8bd8-4772-9f05-3f56e2e637d2 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1501 microversion: 2.1 time: 0.392197 Oct 04 14:31:30.452543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 141/258] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:30 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1501 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:30.504509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:30.506799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:30.520424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.522251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.523266 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.530543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.532879 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.533699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.542342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:30.690287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-1d3ff99f-1565-4de1-9b77-da9d0c0aceeb req-d9839179-1ee3-4cef-abed-343f5c52cadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0417f02f-287b-46b4-871d-cf1cb2faf0ca", "name": "network-vif-deleted", "tag": "0f7c29e1-34b4-4751-9b4d-bf4f577cecc7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:30.728675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-1d3ff99f-1565-4de1-9b77-da9d0c0aceeb req-d9839179-1ee3-4cef-abed-343f5c52cadc service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.729644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-1d3ff99f-1565-4de1-9b77-da9d0c0aceeb req-d9839179-1ee3-4cef-abed-343f5c52cadc service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.730410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-1d3ff99f-1565-4de1-9b77-da9d0c0aceeb req-d9839179-1ee3-4cef-abed-343f5c52cadc service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.779838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-1d3ff99f-1565-4de1-9b77-da9d0c0aceeb req-d9839179-1ee3-4cef-abed-343f5c52cadc service nova] Creating event network-vif-deleted:0f7c29e1-34b4-4751-9b4d-bf4f577cecc7 for instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca on hv-cinder-86026 Oct 04 14:31:30.790351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-1d3ff99f-1565-4de1-9b77-da9d0c0aceeb req-d9839179-1ee3-4cef-abed-343f5c52cadc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105770 Oct 04 14:31:30.794795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 142/259] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:30.804250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:30.805006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:30.820788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.821628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.822282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.823250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.826923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:30.839857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.840397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.843548 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1898e158-6b2e-4928-9a0c-14db7902fc3c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1517 microversion: 2.1 time: 0.352744 Oct 04 14:31:30.857515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 118/260] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:30 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:30.921025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:30.922279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:30.924903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:30.926357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 0417f02f-287b-46b4-871d-cf1cb2faf0ca {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:31.033343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:31.044899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9254a783-8844-475c-8d4a-0b7a6c477606 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1303 microversion: 2.1 time: 0.248502 Oct 04 14:31:31.045501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 143/261] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:30 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:32.074307 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:32.075608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:32.092555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.093759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.095302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:32.096389 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.098208 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.099142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:32.192304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.192847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.194533 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:32.197124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 0417f02f-287b-46b4-871d-cf1cb2faf0ca {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:32.318122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:32.349809 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8dc02021-9a98-4e19-94f7-50532c3a77c5 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 200 len: 1303 microversion: 2.1 time: 0.278582 Oct 04 14:31:32.350952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 119/262] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:32 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 1303 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:32.776846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:32.779971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:32.791094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.792257 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.793032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:32.794216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.795089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.799024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:32.838638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'flavor' on Instance uuid e79b4aa2-e418-4cb4-affc-2cbf5df8547c {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:32.970866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-07fe9ef4-3716-4932-95af-b634c185f55d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/action" status: 200 len: 32 microversion: 2.1 time: 0.197621 Oct 04 14:31:32.971505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 144/263] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:31:32 2022] POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:31:32.982493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:32.983120 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:32.991894 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.992547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.993116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:32.993906 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:32.994430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:32.995331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:33.317736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:33.341897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-371f2729-a862-458b-83be-961b86d0093c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.364053 Oct 04 14:31:33.342723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 120/264] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:32 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:33.375681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:33.376467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 0417f02f-287b-46b4-871d-cf1cb2faf0ca] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:33.384488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:33.385361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:33.388401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:33.389872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:33.390698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:33.391290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:33.410962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] HTTP exception thrown: Instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca could not be found. Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Request method failure captured: Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca HTTP/1.1 Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEOfv7GjJp4N8nsYAk0AzhKjBnyr_qWbUD5rzu-Q2ljf1LtS9JeWu_UMI-MQmdDRJ_lGOGk_mvHaSK-iR9eZacm1IhowY6UBinZ0EemFAs5u6AvwzauoxQajV13ULy8SALPyGqu2OS20EafHsv0BMdtBuQF2sWtUy_NQF6vfy58_oBY Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: ff877a220f9443fb93fde985a653c999 Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesActionsTest-571430534 Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:31:33.413020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ff877a220f9443fb93fde985a653c999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ff877a220f9443fb93fde985a653c999", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ff877a220f9443fb93fde985a653c999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ff877a220f9443fb93fde985a653c999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesActionsTest-571430534 Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: ff877a220f9443fb93fde985a653c999 Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesActionsTest-571430534 Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesActionsTest-571430534-project Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: b3bd51e1acb548ea957ffb57cb09f3f4 Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesActionsTest-571430534-project Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca could not be found. Oct 04 14:31:33.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '0417f02f-287b-46b4-871d-cf1cb2faf0ca'} Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca could not be found. Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:31:33.415343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca could not be found. Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca could not be found. Oct 04 14:31:33.416714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:31:33.418897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Returning 404 to user: Instance 0417f02f-287b-46b4-871d-cf1cb2faf0ca could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:31:33.420096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3b2681b0-ddff-4e9e-b488-3faf36cc79ce tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca" status: 404 len: 111 microversion: 2.1 time: 0.048686 Oct 04 14:31:33.421323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 145/265] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:33 2022] GET /compute/v2.1/servers/0417f02f-287b-46b4-871d-cf1cb2faf0ca => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:31:33.565281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1344011909", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "networks": [{"uuid": "470e3fa5-8495-498c-bd2a-466c324e9bda"}]}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:33.645652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] validate_networks() for [('470e3fa5-8495-498c-bd2a-466c324e9bda', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:31:34.366405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:34.367032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:34.374422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:34.375211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:34.376098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:34.377402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:34.379978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:34.380850 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:34.447696 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:31:34.448219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:31:34.449019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:31:34.449662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:31:34.450202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:31:34.475243 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:34.478177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:34.480263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:34.481371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:34.482092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:34.482717 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:34.508772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Getting quotas for project ff877a220f9443fb93fde985a653c999. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:31:34.514334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Getting quotas for user b3bd51e1acb548ea957ffb57cb09f3f4 and project ff877a220f9443fb93fde985a653c999. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:31:34.528540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:31:34.531254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:31:34.603390 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ba7661c4-6c47-4156-b7ad-d5131d82576d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042021 Oct 04 14:31:34.609926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 121/266] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:31:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:31:34.620544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-757a3a7e-6feb-422b-ae00-3c87977b6d24 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:34.629483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-757a3a7e-6feb-422b-ae00-3c87977b6d24 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:34.758849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:34.769025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-00c65b1f-f2ce-4970-872e-6d760907e222 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.406636 Oct 04 14:31:34.772110 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 146/267] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:34 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:34.932698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-757a3a7e-6feb-422b-ae00-3c87977b6d24 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:34.945147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-757a3a7e-6feb-422b-ae00-3c87977b6d24 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1214 microversion: 2.1 time: 0.330137 Oct 04 14:31:34.946623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 122/268] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:34 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:35.809349 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:35.811406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:35.838112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:35.839506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:35.839727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:35.841060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:35.845993 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:35.847676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:35.977878 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:35.981104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:35.991374 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:35.992266 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:35.992925 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:35.993981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:35.994662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:35.995596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:36.144486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:36.164288 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c8b3a854-7243-4383-9449-2427b10f8a9f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1266 microversion: 2.1 time: 0.189426 Oct 04 14:31:36.165595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 123/269] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:35 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:36.193092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:36.213374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-68ac7e12-b12e-4618-a4d4-3cce042911c6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.413399 Oct 04 14:31:36.220419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 147/270] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:35 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:37.199827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:37.200568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:37.209691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:37.210542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:37.210987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:37.212268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:37.213205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:37.213975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:37.240665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:37.242304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:37.258030 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:37.258829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:37.261235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:37.262355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:37.264276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:37.270435 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:37.418444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:37.432357 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1f4e0880-39bb-4521-963e-3565c4296f1c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1272 microversion: 2.1 time: 0.242645 Oct 04 14:31:37.433796 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 124/271] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:37 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:37.617821 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:37.626105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e6d099ef-0d50-4f3c-bb1e-211f33a9e588 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.390940 Oct 04 14:31:37.626791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 148/272] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:37 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:38.465789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:38.472138 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:38.479155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:38.480364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:38.480977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:38.481830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:38.482427 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:38.482994 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:38.656484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:38.658282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:38.670020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:38.671107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:38.671715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:38.672656 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:38.673402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:38.673990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:38.752536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:38.764164 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-160b4bf5-c9bb-410c-8456-1e259b663a75 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.309496 Oct 04 14:31:38.766284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 125/273] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:38 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:38.895425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:38.906817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-def273ff-68c0-447f-8fc2-8921e3d70b76 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.257683 Oct 04 14:31:38.907793 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 149/274] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:38 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:39.142905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-3e7346cf-2477-47ce-b7d6-b96f766dbbbb req-017b8999-5da0-4c68-950c-051dacef5b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23930569-5670-48a4-9140-d9a32d461d6d", "tag": "f113f5c4-c31e-40ec-9064-e37a5e4bce79"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:39.155188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-3e7346cf-2477-47ce-b7d6-b96f766dbbbb req-017b8999-5da0-4c68-950c-051dacef5b8d service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:39.155909 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-3e7346cf-2477-47ce-b7d6-b96f766dbbbb req-017b8999-5da0-4c68-950c-051dacef5b8d service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:39.156526 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-3e7346cf-2477-47ce-b7d6-b96f766dbbbb req-017b8999-5da0-4c68-950c-051dacef5b8d service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:39.173318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-3e7346cf-2477-47ce-b7d6-b96f766dbbbb req-017b8999-5da0-4c68-950c-051dacef5b8d service nova] Creating event network-changed:f113f5c4-c31e-40ec-9064-e37a5e4bce79 for instance 23930569-5670-48a4-9140-d9a32d461d6d on hv-cinder-86026 Oct 04 14:31:39.180087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-3e7346cf-2477-47ce-b7d6-b96f766dbbbb req-017b8999-5da0-4c68-950c-051dacef5b8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042104 Oct 04 14:31:39.180902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 126/275] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:39.795796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:39.796776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:39.806016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:39.806616 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:39.807131 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:39.807933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:39.808523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:39.809150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:39.932950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:39.934433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:39.945836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:39.946890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:39.947582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:39.948583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:39.949262 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:39.949908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:39.966021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:39.975765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-57c15647-70d2-4679-9895-ad823be03d28 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.185918 Oct 04 14:31:39.989613 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 150/276] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:39 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:40.130293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:40.138506 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-62463044-18bf-4fc3-bfca-27355a2f4f48 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.211061 Oct 04 14:31:40.139099 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 127/277] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:39 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:41.002543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:41.003941 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:41.012255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:41.013376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:41.013820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:41.014965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:41.015866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:41.016484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:41.167024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:41.167797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:41.179776 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:41.182016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:41.182596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:41.183098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:41.183876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:41.184421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:41.185020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:41.192437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:41.209226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-635d405a-b53b-41f5-88b5-c9cb397569e4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.210454 Oct 04 14:31:41.210556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 151/278] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:40 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:41.390350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:41.406057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-feacd807-c40a-4b72-a14e-4a7ed7d8d781 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.244371 Oct 04 14:31:41.407012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 128/279] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:41 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:41.659691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:41.660613 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:41.667705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:41.668401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:41.668924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:41.669722 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:41.670267 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:41.670786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:41.678124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:41.711226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e23a5a44-b496-4f1f-8bb9-67db808c5b60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/ips" status: 200 len: 148 microversion: 2.1 time: 0.056022 Oct 04 14:31:41.711885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 152/280] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:31:41 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/ips => generated 148 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:31:42.238107 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:42.238860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:42.246232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:42.246767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:42.247324 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:42.247914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:42.248722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:42.249325 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:42.452357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:42.452357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:42.457512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:42.457815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:42.458348 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:42.459226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:42.459811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:42.460367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:42.501267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:42.512553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b308a854-7b16-43e6-a7f1-042040ae82c7 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.278207 Oct 04 14:31:42.514887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 129/281] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:42 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:42.822398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:42.842512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-101305eb-1c94-4653-87eb-222d87c455a4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.397532 Oct 04 14:31:42.843411 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 153/282] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:42 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:43.163455 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b57c8593-2a93-4e89-8c54-25e36cec3e22"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:43.166241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:43.175175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:43.176044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:43.177130 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:43.177869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:43.178330 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:43.178908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:43.542240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:43.543073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:43.551058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:43.553709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:43.554429 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:43.555379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:43.556027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:43.558154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:43.672574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2a9b8120-9a7d-4e8e-a6d8-1880cb297073 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513843 Oct 04 14:31:43.673979 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 130/283] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:31:43 2022] POST /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:43.772017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:43.781509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bfb89dee-2de2-4bef-9d89-2d7a0979bb8d tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.243168 Oct 04 14:31:43.782087 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 154/284] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:43 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:43.872985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:43.873986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:43.881302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:43.881795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:43.882238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:43.882991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:43.883487 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:43.884555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:44.083382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:44.092703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-30414822-5df3-4b6b-8247-90fedd2320ae tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.226475 Oct 04 14:31:44.096345 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 131/285] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:43 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:44.522164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-f53f697a-b6ca-45b0-aaae-7f635c719a49 req-357189c1-7ee4-41f2-abd4-7c1f50aacf8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23930569-5670-48a4-9140-d9a32d461d6d", "name": "network-vif-plugged", "status": "completed", "tag": "f113f5c4-c31e-40ec-9064-e37a5e4bce79"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:44.540971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-f53f697a-b6ca-45b0-aaae-7f635c719a49 req-357189c1-7ee4-41f2-abd4-7c1f50aacf8b service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:44.542060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-f53f697a-b6ca-45b0-aaae-7f635c719a49 req-357189c1-7ee4-41f2-abd4-7c1f50aacf8b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:44.542665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-f53f697a-b6ca-45b0-aaae-7f635c719a49 req-357189c1-7ee4-41f2-abd4-7c1f50aacf8b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:44.558557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-f53f697a-b6ca-45b0-aaae-7f635c719a49 req-357189c1-7ee4-41f2-abd4-7c1f50aacf8b service nova] Creating event network-vif-plugged:f113f5c4-c31e-40ec-9064-e37a5e4bce79 for instance 23930569-5670-48a4-9140-d9a32d461d6d on hv-cinder-86026 Oct 04 14:31:44.564918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-f53f697a-b6ca-45b0-aaae-7f635c719a49 req-357189c1-7ee4-41f2-abd4-7c1f50aacf8b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046620 Oct 04 14:31:44.566441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 155/286] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:44.808049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:44.808840 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:44.811613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:44.823949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:44.826221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:44.829315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:44.830392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:44.831184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:44.833809 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:44.942460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=12 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:45.045211 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:45.060421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4c97b7c1-8b52-4336-9825-38e83343ac69 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.255866 Oct 04 14:31:45.061390 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 132/287] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:44 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:45.119872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:45.120601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:45.126958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:45.127550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:45.128118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:45.132446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:45.132446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:45.132446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:45.297502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:45.307741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f3d69922-cd2e-45f4-b131-dd7a63c52609 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.191931 Oct 04 14:31:45.308565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 156/288] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:45 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:46.084304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:46.084867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:46.091392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:46.091873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:46.092303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:46.093016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:46.093458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:46.094423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:46.243200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:46.251454 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c455139b-c994-47bb-b8da-e60947e019a1 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1314 microversion: 2.1 time: 0.171165 Oct 04 14:31:46.252065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 133/289] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:46 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:46.331882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:46.333392 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:46.335603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:46.340933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:46.341427 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:46.341912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:46.342649 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:46.343132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:46.343557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:46.495245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:46.504797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-36f084cd-5ba9-43f1-a765-b03d72e3634f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.177292 Oct 04 14:31:46.505379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 157/290] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:46 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:47.291323 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:47.291885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:47.300191 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:47.300697 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:47.301113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:47.301955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:47.302409 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:47.302819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:47.448250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:47.457239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a1556620-1cc9-48fc-bdc6-6039fb05410f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1498 microversion: 2.1 time: 0.168904 Oct 04 14:31:47.457654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 134/291] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:47 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:47.532486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:47.533132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:47.539612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:47.540094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:47.540560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:47.541290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:47.541786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:47.542143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:47.696656 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:47.705359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8981fe17-3316-4473-a4db-2b07ef28669e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.176901 Oct 04 14:31:47.706051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 158/292] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:47 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:48.357524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:48.358221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:48.365524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:48.366018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:48.366456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:48.367169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:48.367625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:48.368050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:48.385953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:48.401241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:31:48.512785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2144ed9d-05df-432f-9f09-65c9a969619e tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "DELETE /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 204 len: 0 microversion: 2.1 time: 0.158934 Oct 04 14:31:48.514388 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 135/293] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:31:48 2022] DELETE /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:31:48.528191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:48.528990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:48.538347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:48.539161 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:48.539868 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:48.540950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:48.541597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:48.542221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:48.725112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:48.735492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:48.737144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:48.739024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-807cf94f-c88d-4a5a-af00-01db3f948280 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.217212 Oct 04 14:31:48.740013 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 159/294] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:48 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:48.747663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:48.748161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:48.748632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:48.749344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:48.749810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:48.750241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:48.904276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:48.914995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-aee5c296-ab50-4077-adf3-97d695ade423 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.188042 Oct 04 14:31:48.915586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 136/295] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:48 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:49.777278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:49.778763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:49.787795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:49.788298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:49.788809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:49.789483 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:49.789938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:49.790401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:49.808877 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:49.809476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:49.816962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:49.817472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:49.817928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:49.818644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:49.819084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:49.819512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:49.849615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a3972a3e-ba4b-42fc-a29e-c788718b50d0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/ips" status: 200 len: 152 microversion: 2.20 time: 0.044569 Oct 04 14:31:49.850205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 137/296] 10.222.0.64 () {60 vars in 1289 bytes} [Tue Oct 4 14:31:49 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:31:49.938476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:49.939095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:49.948948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:49.951266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:49.957278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:49.959061 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:49.959999 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:49.961151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ea53f133-48c8-45f3-af5e-26e8cdedba30 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.190211 Oct 04 14:31:49.972037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 160/297] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:49 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:49.976693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:49.977250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:50.138293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:50.149636 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c3b61217-0f3c-4544-b1b9-4fc96f26b151 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.215552 Oct 04 14:31:50.160876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 138/298] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:49 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:50.989129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:50.989807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:50.996015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:50.996541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:50.996987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:50.997695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:50.998197 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:50.998556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:51.141013 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:51.150399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8e598fdd-9a84-4b2c-81c3-9c782d951cf4 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.165338 Oct 04 14:31:51.150968 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 161/299] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:50 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:51.180786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:51.181393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:51.188208 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:51.188723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:51.189160 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:51.189839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:51.190327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:51.190739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:51.357415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:51.366670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3aa7baad-e694-421b-b3f3-a5cee4263b68 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.189765 Oct 04 14:31:51.367726 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 139/300] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:51 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:52.152495 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:52.153061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:52.159547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:52.160032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:52.160496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:52.161190 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:52.161640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:52.162063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:52.179645 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:52.180437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:52.186490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3133b83a-0d2d-452e-a5ff-e717b9a58538 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/ips" status: 200 len: 145 microversion: 2.1 time: 0.037943 Oct 04 14:31:52.186732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:52.187351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 162/301] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:31:52 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:52.187447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:52.187629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:52.188336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:52.188891 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:52.189209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:52.334378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:52.342600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-57247aa7-c9cb-4051-8f5c-18f0c1c6e031 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.166739 Oct 04 14:31:52.343216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 140/302] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:52 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:52.390128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:52.390721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:52.397216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:52.397690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:52.398144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:52.398807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:52.399248 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:52.399666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:52.539988 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:52.549565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f0e1cffc-6a53-4f49-a4f0-43579e892c58 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.163085 Oct 04 14:31:52.557862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 163/303] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:52 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:53.367464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:53.368077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:53.374631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:53.375114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:53.375552 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:53.376246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:53.376736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:53.377157 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:53.576258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:53.576878 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:53.583705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:53.584294 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:53.585177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:53.585900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:53.586352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:53.586819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:53.669207 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:53.678244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-db49ea06-5e2f-4425-b334-b59ca22e158c tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.314573 Oct 04 14:31:53.679158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 141/304] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:53 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:53.741463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:53.749359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-32a7f312-27de-494e-b04c-ed318d91ef03 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.176955 Oct 04 14:31:53.749932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 164/305] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:53 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:54.186572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:54.187126 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:54.193641 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.194053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.194479 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.195175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.195614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.196034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.222915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lazy-loading 'flavor' on Instance uuid 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:54.454489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7070ea6d-81c4-4acb-8661-e03e3dec6360 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/action" status: 202 len: 0 microversion: 2.20 time: 0.271652 Oct 04 14:31:54.455284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 142/306] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Oct 4 14:31:54 2022] POST /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:31:54.463978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:54.464602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:54.470977 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.472305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.472783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.473528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.473981 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.474400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.618572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:54.628371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:54.630102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:54.631257 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-26e01d16-519e-497e-ba30-712de0766003 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.171257 Oct 04 14:31:54.631869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 165/307] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:31:54 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:31:54.702552 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:54.703255 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:54.709755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.710213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.711046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.711768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.712228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.712682 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.773508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:54.774212 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:54.780543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.781029 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.781463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.782420 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:54.782880 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:54.783302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:54.928475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:54.937024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5bcf1e14-f73a-4657-91c7-481d0e75ad52 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.167242 Oct 04 14:31:54.937619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 166/308] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:54 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:55.082809 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:55.090556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-57bb24bb-2dab-4062-a8bf-69cef0d071ec tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.392347 Oct 04 14:31:55.091125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 143/309] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:54 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:55.657499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:55.658284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:55.665316 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:55.665812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:55.666249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:55.666958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:55.667412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:55.667834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:55.817944 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:55.827225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:55.828759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:55.829975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ed89f9a2-a30c-47fd-84d7-3c85f9875e67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.176797 Oct 04 14:31:55.830596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 167/310] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:31:55 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:31:55.961652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:55.962375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:55.969370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:55.969872 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:55.970309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:55.971038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:55.972191 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:55.972654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:56.113239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:56.114042 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:56.114663 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:56.120801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:56.121293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:56.121731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:56.122460 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:56.122913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:56.123342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:56.129938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e40d4255-eca6-445c-9328-d2c0c80296ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.171810 Oct 04 14:31:56.131267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 144/311] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:55 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:56.266507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:56.275219 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8df88f65-a942-4e4f-81f4-da299cf86d8f tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.165055 Oct 04 14:31:56.275904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 168/312] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:56 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:56.856472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:56.857092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:56.864337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:56.864829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:56.865272 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:56.866240 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:56.866805 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:56.867525 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:57.056627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:57.066726 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:57.068169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:57.069837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a821734d-f196-4501-bc09-8d68f175c83f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.217401 Oct 04 14:31:57.070481 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 145/313] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:31:56 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:31:57.158479 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:57.161142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:57.177398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:57.178151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:57.179546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:57.181851 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:57.182673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:57.183231 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:57.300109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:57.300981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:57.308500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:57.308850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:57.309308 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:57.310215 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:57.310642 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:57.311119 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:57.340435 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:57.364711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-71f519c5-cf1d-42e6-b444-366b3d7a81a1 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.211836 Oct 04 14:31:57.366105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 169/314] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:57 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:57.460825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:57.469021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-28b36b7d-11f1-47e9-ac1a-9e7362630caa tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1504 microversion: 2.1 time: 0.173304 Oct 04 14:31:57.469608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 146/315] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:57 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:58.015573 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-e53628c3-933a-46bf-bb08-1479be5d10e4 req-eddd0a0a-e07b-4c01-8c4c-df01e96ace3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23930569-5670-48a4-9140-d9a32d461d6d", "name": "network-vif-deleted", "tag": "f113f5c4-c31e-40ec-9064-e37a5e4bce79"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:58.040602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e53628c3-933a-46bf-bb08-1479be5d10e4 req-eddd0a0a-e07b-4c01-8c4c-df01e96ace3e service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.040602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e53628c3-933a-46bf-bb08-1479be5d10e4 req-eddd0a0a-e07b-4c01-8c4c-df01e96ace3e service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.040602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e53628c3-933a-46bf-bb08-1479be5d10e4 req-eddd0a0a-e07b-4c01-8c4c-df01e96ace3e service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.059676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:58.066221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9f4a0553-c353-4baf-9ba2-a350842badcf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: .version_select at 0x7f5718927e50>, body: {"keypair": {"name": "tempest-keypair-1320786995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsnMhhukfc5WFmj7CA7mN/OnpwXx2Wmbl5uaMrs86jEqUuK6sKu+lk8ZgRJ9YyAU0h3hLXMFghXofWcXXlAsBLbsS1OzAf+wJVKGvZBgeIocNwsg1VTZ4DSlvTNJn0RIQ=="}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:58.079763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-e53628c3-933a-46bf-bb08-1479be5d10e4 req-eddd0a0a-e07b-4c01-8c4c-df01e96ace3e service nova] Creating event network-vif-deleted:f113f5c4-c31e-40ec-9064-e37a5e4bce79 for instance 23930569-5670-48a4-9140-d9a32d461d6d on hv-cinder-86026 Oct 04 14:31:58.086334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-9f4a0553-c353-4baf-9ba2-a350842badcf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:31:58.087316 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-e53628c3-933a-46bf-bb08-1479be5d10e4 req-eddd0a0a-e07b-4c01-8c4c-df01e96ace3e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075949 Oct 04 14:31:58.090862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 170/316] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:58.091206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-9f4a0553-c353-4baf-9ba2-a350842badcf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:31:58.099088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:58.099794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:58.106424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.106932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.107360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.108642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.109273 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.110711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.124252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9f4a0553-c353-4baf-9ba2-a350842badcf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064438 Oct 04 14:31:58.130800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 147/317] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:31:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:58.222576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "928ef74a-6b90-475f-84d6-be0931857070"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:58.231424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:58.246984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.248638 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.251054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.252058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.253328 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.253867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.316454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:58.325172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:58.326614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:58.327798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aaa90e54-5f1a-482d-a4bb-ee62a2372ad3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.235209 Oct 04 14:31:58.328377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 171/318] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:31:58 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:31:58.392711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:58.394327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:58.406047 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.409130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.410477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.412740 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:58.413214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:58.414033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:58.643587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:58.661546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-81708d16-5d7a-474e-bf1c-b019b6f68802 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.276761 Oct 04 14:31:58.662953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 172/319] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:58 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:58.669815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1516540284", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1694566594", "security_groups": [{"name": "tempest-secgroup-smoke-2039710880"}], "block_device_mapping_v2": [{"uuid": "8db933b1-dab0-4650-8b80-77bb3eb71f66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4116101e-9cfb-4512-a759-154f86437ec3"}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:31:59.016123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] validate_networks() for [('4116101e-9cfb-4512-a759-154f86437ec3', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:31:59.038135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:31:59.067378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-51c2d1fa-7d30-4c1c-96ed-2fdcca8700d5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854069 Oct 04 14:31:59.074678 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 148/320] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:31:58 2022] POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:31:59.090873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:59.091576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:59.111229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.115643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.116235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.117016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.117538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.117966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.192782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.193486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.194066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.194659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 23930569-5670-48a4-9140-d9a32d461d6d {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:31:59.245519 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:59.255520 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b7245964-4291-47f5-b980-d500585a6260 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1304 microversion: 2.1 time: 0.176553 Oct 04 14:31:59.256195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 149/321] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:59 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:31:59.361085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:59.361992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:59.370059 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.370816 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.371260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.371986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.372488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.372908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.534679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:59.543759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:59.545648 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:59.547068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fb1e1bdc-c2d4-4c35-80ef-51c3f469797f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.190249 Oct 04 14:31:59.547841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 150/322] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:31:59 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:31:59.687418 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:31:59.688132 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:31:59.697972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.698676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.699228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.700154 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:31:59.700871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:31:59.701543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:31:59.870966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:31:59.895027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0e6fa1a8-47e1-4430-a063-89748cbdcf1c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.212574 Oct 04 14:31:59.895987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 151/323] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:31:59 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:31:59.990007 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:31:59.990490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:31:59.991067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:31:59.991463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:31:59.991863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:32:00.001548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.002032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.002975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.004070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.004917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.005271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.026752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for project 408b16a582484c619ff17416990d5feb. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:32:00.032754 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for user c7028d2ccede4b44b567387bb83c4579 and project 408b16a582484c619ff17416990d5feb. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:32:00.101709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:32:00.105243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8db933b1-dab0-4650-8b80-77bb3eb71f66',volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:32:00.268565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2b1c4e42-5a37-4dbe-bf34-144d2e83ed96 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.603483 Oct 04 14:32:00.269371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 173/324] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:31:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:32:00.289326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:00.291323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1d073190-5fe8-4193-9dd1-19acb4e46d9d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:00.292404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:00.293216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1d073190-5fe8-4193-9dd1-19acb4e46d9d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:00.312995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.313518 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.313967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.315395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.315862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.316295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.352868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.353347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.353963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.354427 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 23930569-5670-48a4-9140-d9a32d461d6d {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:32:00.396241 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1d073190-5fe8-4193-9dd1-19acb4e46d9d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:00.404271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1d073190-5fe8-4193-9dd1-19acb4e46d9d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1095 microversion: 2.1 time: 0.118150 Oct 04 14:32:00.405252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 174/325] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:00 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1095 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:00.425724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:00.434289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1520b39f-53fe-445a-b95c-cb7524fbac51 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1304 microversion: 2.1 time: 0.155699 Oct 04 14:32:00.435048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 152/326] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:00 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:00.579007 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:00.579698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:00.590961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.590961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.590961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.590961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.591367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.591570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.714147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1658630266", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e89e862-e669-4987-af44-eb18dbc3b78d"}], "security_groups": [{"name": "tempest-securitygroup--550992625"}], "key_name": "tempest-keypair-1320786995", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:00.747845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:00.757702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:00.759346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:00.761305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b7d92cad-99ba-4878-b698-1b059d371830 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.190456 Oct 04 14:32:00.762197 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 175/327] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:00 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:00.854310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] validate_networks() for [('3e89e862-e669-4987-af44-eb18dbc3b78d', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:32:00.927546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:00.928716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:00.941611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.942026 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.942453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:00.943160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:00.943607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:00.944022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.092860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.101398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f47eee97-d143-44f2-b755-e7b1a5979ca7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.178736 Oct 04 14:32:01.101980 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 176/328] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:00 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:01.298202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:32:01.298869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:32:01.299966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:32:01.300601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:32:01.301087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:32:01.310927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.311463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.311964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.312896 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.313344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.313890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.333106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:32:01.338397 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:32:01.350148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:32:01.352479 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:32:01.404922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3f691a66-072e-4e99-8d17-326c0352ebab tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.696638 Oct 04 14:32:01.405565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 153/329] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:32:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:32:01.417842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e7c9a35b-dd6d-4d26-87fc-26eca4a4ce9c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:01.418453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e7c9a35b-dd6d-4d26-87fc-26eca4a4ce9c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:01.429827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:01.430442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:01.437542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.438216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.439080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.440286 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.441113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.442202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.504890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e7c9a35b-dd6d-4d26-87fc-26eca4a4ce9c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.512374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e7c9a35b-dd6d-4d26-87fc-26eca4a4ce9c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1242 microversion: 2.1 time: 0.098321 Oct 04 14:32:01.515963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.516553 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 177/330] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:01 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:01.521914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:01.523124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:01.529263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5759759c-e7b5-4ffa-a04b-d893a2a0ca6e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1145 microversion: 2.1 time: 0.105675 Oct 04 14:32:01.530142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.530297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 154/331] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:01 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:01.531095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.531523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.532573 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.532955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.533958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.568802 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.569437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.569788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.570128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 23930569-5670-48a4-9140-d9a32d461d6d {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:32:01.613010 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.621248 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1f6a1773-5eb5-4f1c-828b-0a57e6654656 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1304 microversion: 2.1 time: 0.103811 Oct 04 14:32:01.621833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 178/332] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:01 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:01.789856 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:01.790640 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:01.797735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.798228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.798672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.800080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:01.800600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:01.801047 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:01.938351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.950047 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.951521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:01.952744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8f402f49-5ee3-47b8-b1c4-2bae0b3e7046 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.167385 Oct 04 14:32:01.953405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 155/333] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:01 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:02.126098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:02.126701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:02.132697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.133175 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.133603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.134284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.134733 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.135147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.279141 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:02.290679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-938dae55-52b4-4520-9749-6da4804a7edc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.168310 Oct 04 14:32:02.291713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 179/334] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:02 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:02.536699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:02.537308 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:02.544197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.544713 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.545150 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.545861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.546314 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.546745 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.556047 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:02.556697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:02.563906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.564423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.564912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.565823 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.566282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.566730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.628346 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:02.636934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c34e75e5-0244-465f-a6a0-8d319e4d63f3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1246 microversion: 2.1 time: 0.105237 Oct 04 14:32:02.637538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 156/335] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:02 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:02.643734 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:02.652434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:02.653327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:02.655863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4e42bacb-9c00-41a4-911b-bafff64232a9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1137 microversion: 2.1 time: 0.103328 Oct 04 14:32:02.656833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 180/336] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:02 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1137 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:02.663106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.663923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.664763 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.665997 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.666823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.667584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.701248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.701731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.702167 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.702853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 23930569-5670-48a4-9140-d9a32d461d6d {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:32:02.746912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:02.755785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6e938147-e40a-48b7-9897-e9140f64bb86 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1304 microversion: 2.1 time: 0.109188 Oct 04 14:32:02.756389 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 157/337] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:02 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:02.980080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:02.980730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:02.987619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.988165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.988626 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:02.989335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:02.989782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:02.990205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.149732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.163673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.165690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.168390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-693de64e-f7ce-4a7a-8cb6-ef3f082e0b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.192141 Oct 04 14:32:03.169166 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 181/338] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:02 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:03.316502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:03.317199 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:03.323756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.324576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.325085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.326029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.326669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.327198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.488427 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.499740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-be89738c-0387-48f8-8ed7-890d44204e02 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.188442 Oct 04 14:32:03.500466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 158/339] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:03 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:03.660870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:03.661486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:03.668445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.668940 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.669380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.670111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.670553 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.671022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.682158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:03.682846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:03.685640 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:03.694657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.695546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.696810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.697700 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.698576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.699471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.760512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.771106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2eb99bcf-c467-49b8-a78d-32f7544f47c5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.114769 Oct 04 14:32:03.772715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 182/340] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:03 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:03.794508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:03.795242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:03.804554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.805245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.806041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.806985 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.807880 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.808491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.822812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.848127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:03.849111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:03.849801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:03.850447 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lazy-loading 'fault' on Instance uuid 23930569-5670-48a4-9140-d9a32d461d6d {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:32:03.881149 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0cdf9f26-a196-4cce-af06-831abb3035e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1137 microversion: 2.1 time: 0.202377 Oct 04 14:32:03.882117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 159/341] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:03 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1137 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:03.918915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3bd51e1acb548ea957ffb57cb09f3f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff877a220f9443fb93fde985a653c999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:03.928400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3ea050c0-9f56-4ff3-bea1-2d51940f52cc tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 200 len: 1304 microversion: 2.1 time: 0.137933 Oct 04 14:32:03.929058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 183/342] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:03 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:04.197010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:04.197623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.203687 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.204173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.204643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.205364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.205845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.206245 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.359040 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:04.374441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:04.376101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:04.378412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-13737548-ab5e-40c5-8745-be720138a290 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.184964 Oct 04 14:32:04.379528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 160/343] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:04 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:04.523142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:04.523938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.529964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.530476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.530905 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.531601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.532052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.532775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.709640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:04.717599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ff6a5eef-5a3e-479c-9efb-ad4f749d32dc tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1503 microversion: 2.1 time: 0.198636 Oct 04 14:32:04.718174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 184/344] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:04 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:04.740860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00b715e5-595a-425b-8a30-3a911e2b9602"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:04.744027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.752515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.753385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.754036 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.755042 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.755687 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.756390 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.786912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] HTTP exception thrown: Cannot 'attach_volume' instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c while it is in vm_state rescued Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Request method failure captured: Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/os-volume_attachments HTTP/1.1 Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 74 Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENd645BW0PdaWe-YwDoffCgwpYWCio58x6Ai1V3CQDWp9xhPbUjAW1BffH4YPXEQVQ_drSOgAgX41jji4KCaHWx4yCTkcysZ2k1XQjjdHZLHdsuNEsXAGreSCLKKPLJnooIoXNGtvB6_mJvjinDG11Hu96hUB2daSUFGkN6DasRMA8 Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:32:04.788944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec24f1b720bd42ebb37a36d65757aacd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 2b4c980bac3e444faa0e6f1a1d270cfa Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {"volumeAttachment": {"volumeId": "00b715e5-595a-425b-8a30-3a911e2b9602"}} Oct 04 14:32:04.790292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Cannot 'attach_volume' instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c while it is in vm_state rescued Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'server_id': 'e79b4aa2-e418-4cb4-affc-2cbf5df8547c', 'body': {'volumeAttachment': {'volumeId': '00b715e5-595a-425b-8a30-3a911e2b9602'}}} Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:32:04.791015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c while it is in vm_state rescued Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:32:04.792200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:32:04.793771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:32:04.793771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:32:04.793771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c while it is in vm_state rescued Oct 04 14:32:04.793771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:32:04.795226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Returning 409 to user: Cannot 'attach_volume' instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c while it is in vm_state rescued {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:32:04.796342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b9768d53-4f68-4575-ab4c-88b8b1764521 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059719 Oct 04 14:32:04.797419 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 161/345] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:32:04 2022] POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 14:32:04.807950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:04.808688 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.809353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:04.809899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.815855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.816588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.817019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.818012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.818671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.819272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.823815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.824494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.828438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.832506 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.833544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.834786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.893187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:04.920255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-70d44545-d364-4421-8b6b-e20669e8e0be tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.122385 Oct 04 14:32:04.922185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 185/346] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:04 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:04.928020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:04.929182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.937425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.939331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.939331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.940628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.940901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2aeecaca-f17d-4b89-8162-3b896207f69b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/action" status: 202 len: 0 microversion: 2.1 time: 0.135114 Oct 04 14:32:04.941387 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.941549 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 162/347] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:32:04 2022] POST /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:32:04.942457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.951829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:04.951829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:04.958082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.958502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.958937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:04.959673 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:04.960523 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:04.960658 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.017466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:05.028373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-13b2577a-28f5-4580-9961-29dbf1116af8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1193 microversion: 2.1 time: 0.105140 Oct 04 14:32:05.032689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 186/348] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:04 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:05.042437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:05.043647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] [instance: 23930569-5670-48a4-9140-d9a32d461d6d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:05.062327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:05.062824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:05.063311 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.063966 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:05.064616 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:05.065050 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.081909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] HTTP exception thrown: Instance 23930569-5670-48a4-9140-d9a32d461d6d could not be found. Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Request method failure captured: Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d HTTP/1.1 Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEOfv7GjJp4N8nsYAk0AzhKjBnyr_qWbUD5rzu-Q2ljf1LtS9JeWu_UMI-MQmdDRJ_lGOGk_mvHaSK-iR9eZacm1IhowY6UBinZ0EemFAs5u6AvwzauoxQajV13ULy8SALPyGqu2OS20EafHsv0BMdtBuQF2sWtUy_NQF6vfy58_oBY Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: ff877a220f9443fb93fde985a653c999 Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesActionsTest-571430534 Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:32:05.083762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ff877a220f9443fb93fde985a653c999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ff877a220f9443fb93fde985a653c999", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ff877a220f9443fb93fde985a653c999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ff877a220f9443fb93fde985a653c999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesActionsTest-571430534 Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: ff877a220f9443fb93fde985a653c999 Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesActionsTest-571430534 Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesActionsTest-571430534-project Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: b3bd51e1acb548ea957ffb57cb09f3f4 Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesActionsTest-571430534-project Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 23930569-5670-48a4-9140-d9a32d461d6d could not be found. Oct 04 14:32:05.085035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '23930569-5670-48a4-9140-d9a32d461d6d'} Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23930569-5670-48a4-9140-d9a32d461d6d could not be found. Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:32:05.085731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23930569-5670-48a4-9140-d9a32d461d6d could not be found. Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23930569-5670-48a4-9140-d9a32d461d6d could not be found. Oct 04 14:32:05.087094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:32:05.088488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] Returning 404 to user: Instance 23930569-5670-48a4-9140-d9a32d461d6d could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:32:05.088488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2e69da9f-d195-42b0-aae0-374d41cb0244 tempest-VolumesActionsTest-571430534 tempest-VolumesActionsTest-571430534-project] 10.222.0.64 "GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d" status: 404 len: 111 microversion: 2.1 time: 0.049753 Oct 04 14:32:05.088488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 187/349] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:05 2022] GET /compute/v2.1/servers/23930569-5670-48a4-9140-d9a32d461d6d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:32:05.118549 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:05.127941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-08f48096-968d-40d0-880d-f4d2bf11595a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.180938 Oct 04 14:32:05.129025 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 163/350] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:04 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:05.407634 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:05.408950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:05.415527 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:05.416013 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:05.416580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.417202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:05.417663 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:05.418073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.562163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:05.571004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:05.572608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:05.573919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-173654a6-5294-43f3-8bc6-82e503a15eba tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.170661 Oct 04 14:32:05.574561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 188/351] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:05 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:05.953515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:05.954407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:05.961676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:05.962171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:05.962611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.963560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:05.963804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:05.964230 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:05.967371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:06.033292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:06.041281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2e0076ea-6256-422e-88b5-8df2e0c4f9d5 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.093946 Oct 04 14:32:06.041994 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 164/352] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:05 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:06.059671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:06.060333 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:06.067238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:06.067715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:06.068144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:06.068881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:06.069328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:06.069755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:06.134351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:06.142027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5c5b2977-f2d8-4602-a9c5-a78e1a8d23a0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1193 microversion: 2.1 time: 0.086514 Oct 04 14:32:06.142689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 189/353] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:06 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:06.151862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:06.152722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:06.159210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:06.159699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:06.160137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:06.160887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:06.161379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:06.161808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:06.300015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:06.308056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d10f19bf-290a-499d-bced-d6fcb203a460 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.160884 Oct 04 14:32:06.308675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 165/354] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:06 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:06.601721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:06.602272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:06.608177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:06.608695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:06.609122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:06.609811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:06.610255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:06.610668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:06.614824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:06.750256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:06.759164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:06.760673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:06.761849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bdb9a7c5-b660-4eb1-957b-23d589d9915a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.164151 Oct 04 14:32:06.762412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 190/355] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:06 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:07.065849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:07.066649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:07.073469 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.073964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.074404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.075125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.075582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.076011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.141690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:07.149581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d04401c5-72b9-4eb0-9845-ade5de6ea26c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.088420 Oct 04 14:32:07.150148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 166/356] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:07 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:07.167496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:07.168110 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:07.174873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.175452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.175887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.176620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.177079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.177504 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.248531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:07.257225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-319ed435-d7e0-43bc-a40f-ff13ec826735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1193 microversion: 2.1 time: 0.095472 Oct 04 14:32:07.257836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 191/357] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:07 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:07.331146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:07.331970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:07.338542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.339031 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.339463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.340518 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.340982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.341407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.483883 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:07.493156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e6fa4f3d-d65e-4132-afd5-33e82f88b2bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.165895 Oct 04 14:32:07.493662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 167/358] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:07 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:07.788032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:07.788664 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:07.794958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.795516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.795948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.796682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:07.797119 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:07.797533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:07.948386 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:07.957036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:07.958623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:07.959816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f9605581-ba2f-4897-a7a7-ad304e98c43b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.176348 Oct 04 14:32:07.960400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 192/359] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:07 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:08.175535 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:08.176729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:08.184256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.184964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.185449 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.186135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.186762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.187344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.280861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:08.281472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:08.288551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.289136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.289329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:08.289479 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.290181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.290640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.291060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.302953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c8e4191e-7d22-436e-9fbf-f02e5aa23e94 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.132914 Oct 04 14:32:08.304210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 168/360] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:08 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:08.367334 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:08.375832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-78d5b29f-5822-451c-a421-8187ba7f9b42 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1193 microversion: 2.1 time: 0.098746 Oct 04 14:32:08.376465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 193/361] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:08 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:08.516622 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:08.517181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:08.523226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.523705 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.524136 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.524890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.525311 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.525726 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.665912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:08.674542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7d054ec3-e40e-4e49-987e-d4f6b671604d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.161345 Oct 04 14:32:08.675123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 169/362] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:08 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:08.958022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7ba449d8-ca52-4e67-8dca-0b91322583a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:08.964545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ba449d8-ca52-4e67-8dca-0b91322583a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:08.965036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ba449d8-ca52-4e67-8dca-0b91322583a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:08.965693 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ba449d8-ca52-4e67-8dca-0b91322583a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:08.990497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:08.991650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:09.001724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.001724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.002961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.003676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.004358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.004949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.034938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7ba449d8-ca52-4e67-8dca-0b91322583a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Going to try to stop instance {{(pid=120821) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 14:32:09.082922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7ba449d8-ca52-4e67-8dca-0b91322583a5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action" status: 202 len: 0 microversion: 2.1 time: 0.129610 Oct 04 14:32:09.083530 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 194/363] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:32:08 2022] POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:32:09.093347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:09.094033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:09.098064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:09.102325 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.102808 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.103248 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.103923 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.104395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.104817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.149184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.159315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.160783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.162019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f2df8e00-f8e5-47b0-a9bd-63a7c7eb07d7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.179153 Oct 04 14:32:09.162735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 170/364] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:08 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:09.254389 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.263385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3b224ff1-0d36-4c4b-b71d-86a9639dec58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.174511 Oct 04 14:32:09.263979 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 195/365] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:09 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:09.330694 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:09.331443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:09.338639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.339120 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.339554 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.340256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.340750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.341173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.400144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:09.401141 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:09.412432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.412753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.413074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.414063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.415362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.415842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.416869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.422607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-21c5760c-bd8d-4f71-a16d-928b6691b0a0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.095551 Oct 04 14:32:09.423342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 171/366] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:09 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:09.481960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.491286 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9412e534-97ff-448a-ae8b-1292c7dc54e3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1193 microversion: 2.1 time: 0.095557 Oct 04 14:32:09.491874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 196/367] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:09 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:09.699408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:09.700027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:09.706513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.707008 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.707559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.708168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:09.708655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:09.709082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:09.849360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:09.859670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7892b61a-9da0-4b0b-a41f-3b4a44017351 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.164001 Oct 04 14:32:09.860862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 172/368] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:09 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:10.187819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:10.188451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:10.190960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:10.196870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.197355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.197789 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.198492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.198943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.199367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.287551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:10.288153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:10.294969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.295437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.295866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.296606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.297056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.297481 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.346973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:10.357153 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:10.358639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:10.359817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2ce1c845-faf7-4eda-98e3-91ead5d3f28d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.175954 Oct 04 14:32:10.360402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 197/369] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:10 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:10.440946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:10.450046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c8d524a4-384d-4c8c-88aa-263d919eeaf3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.166444 Oct 04 14:32:10.460336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 173/370] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:10 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:10.472678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:10.473302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:10.480011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.480679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.481163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.481886 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.482342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.482768 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.514982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:10.515703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:10.522596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.523078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.523513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.524546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.524755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.525154 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.568007 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:10.575943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0b4c3f22-7954-4518-b6f8-a6c6c1733b77 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1238 microversion: 2.1 time: 0.107943 Oct 04 14:32:10.576555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 198/371] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:10 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:10.612562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:10.620378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-827bf089-c95b-4e22-a7e6-74ced3bcc81c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1193 microversion: 2.1 time: 0.109313 Oct 04 14:32:10.620949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 174/372] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:10 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:10.889759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:10.890366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:10.897252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.897738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.898172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:10.898869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:10.899321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:10.899744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.041610 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.052120 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-41c7e57a-0fe1-4bd5-871d-2ad901892c83 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.166081 Oct 04 14:32:11.064094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 199/373] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:10 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:11.387134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:11.387740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:11.389749 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:11.391235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=10 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:11.398294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.398787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.399299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.400049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.400600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.401140 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.480166 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:11.480930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:11.488866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.489356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.489788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.490496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.490947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.491371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.515687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=10 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:11.650150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.661560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0fd56ceb-c74e-4b08-bc7f-1a6f1017dc48 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.188829 Oct 04 14:32:11.662454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 200/374] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:11 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:11.667428 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:11.668041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:11.683492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.683989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.684445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.685157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.685608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.686027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.727390 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.736034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.739148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.740360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4fd661a3-a429-400c-89b2-f0bfa663a4cc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.357182 Oct 04 14:32:11.742644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 175/375] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:11 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:11.751636 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:11.752347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:11.761292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.762507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.763103 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.764465 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:11.765077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:11.765688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:11.812498 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.824801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-411b05ea-a520-4004-8c61-5bd855ffde8e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1294 microversion: 2.1 time: 0.160557 Oct 04 14:32:11.825738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 201/376] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:11 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:11.866956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:11.875474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-27306b08-6873-4047-8b1c-6c576a63dcfc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1211 microversion: 2.1 time: 0.131241 Oct 04 14:32:11.876062 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 176/377] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:11 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:12.079253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:12.080150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:12.087145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.087748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.088298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.089128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.089720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.090237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.260445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:12.272092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-62f63fde-9bc3-4469-b081-7ad6c28b3f15 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.196715 Oct 04 14:32:12.272730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 202/378] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:12 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:12.686471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:12.687099 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:12.697091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.697534 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.698300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.699169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.699785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.700424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.782390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:12.784929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:12.802519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.803529 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.804390 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.806423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.807541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.809044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.900796 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:12.950706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-25522f1f-54d2-4937-b61d-c7e99a69d0a4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.267476 Oct 04 14:32:12.952075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 177/379] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:12 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:12.971773 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:12.972539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:12.979462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.980219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.981003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:12.981932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:12.982584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:12.983226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:13.021977 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:13.035099 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:13.036753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:13.038097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8c5cdb4a-5956-4e3e-90ef-daa65e1c0b0b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.271165 Oct 04 14:32:13.050017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 203/380] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:12 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:13.050017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:13.050017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:13.063318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:13.063935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:13.067921 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:13.070405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:13.070549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:13.075814 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:13.126607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:13.138780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-11f59469-75e6-4f37-a89f-f2936c257141 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1300 microversion: 2.1 time: 0.185024 Oct 04 14:32:13.139561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 178/381] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:12 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:13.260806 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:13.269749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-34fb1205-c098-4e26-87c1-794328b3dd61 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1279 microversion: 2.1 time: 0.229494 Oct 04 14:32:13.270327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 204/382] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:13 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1279 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:13.297572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:13.298184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:13.305077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:13.305077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:13.305442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:13.306334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:13.306936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:13.307584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:13.452563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:13.461326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-75c8fd56-ce29-41cb-be92-8287d7cbcac6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.167762 Oct 04 14:32:13.461905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 179/383] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:13 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:13.974987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:13.975845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:13.983817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:13.984731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:13.985883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:13.987397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:13.987949 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:13.988419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.067358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:14.068080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:14.075231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.075761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.076157 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.076894 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.077347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.077770 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.130082 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.133632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:14.139739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ed952df5-0c4f-4fca-90b2-09f91a6372bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.169137 Oct 04 14:32:14.140340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 205/384] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:13 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:14.178081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:14.178805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:14.185615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.186100 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.186536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.187238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.187696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.188119 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.231474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.235166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:14.241806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.243301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.244537 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0b03d024-da49-4f08-8d43-790491591885 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.182119 Oct 04 14:32:14.245107 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 180/385] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:14 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:14.258506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.266383 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2763d7b1-0948-49be-992b-e80b2a48d021 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1300 microversion: 2.1 time: 0.093771 Oct 04 14:32:14.266947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 206/386] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:14 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:14.293374 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:14.293984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:14.300303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.300820 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.301265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.301966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.303019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.303019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.441248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.449507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f5c9b8a7-c170-4878-b0c3-93fa733faffd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1279 microversion: 2.1 time: 0.160222 Oct 04 14:32:14.450094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 181/387] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:14 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:14.484355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:14.484959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:14.491414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.491918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.492338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.493036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:14.493482 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:14.493899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:14.633946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:14.643526 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b6416128-ca3c-4a58-8eb8-ba7a3c5ccd9f tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.162977 Oct 04 14:32:14.644776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 207/388] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:14 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:15.171563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:15.172769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:15.181292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.181292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.182047 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.182419 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.182772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.183408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.280074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:15.286102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:15.307849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.310000 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.311529 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.316330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.317955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.319250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.358644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.368807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-40918afc-055a-4396-9e51-ce411f31933a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.201902 Oct 04 14:32:15.369685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 182/389] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:15 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:15.375664 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:15.377848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:15.389689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.390471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.391077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.392073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.393155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.393899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.505159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.517995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a4b96720-bf2b-4ad6-a21a-e96154d9b347 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1300 microversion: 2.1 time: 0.146990 Oct 04 14:32:15.527094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 183/390] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:15 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:15.536222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:15.538594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:15.546834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.547315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.548159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.549486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.550250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.550698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.613788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.627101 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.628617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.629984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-77a52b07-de17-4b50-b44a-bcfe0fc44f50 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.362683 Oct 04 14:32:15.644819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 208/391] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:15 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:15.684139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:15.685905 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:15.699571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.700160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.700711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.701496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:15.702283 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:15.702505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:15.771429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.782832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a57d6100-8d87-4f89-88d3-e4e331add47d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1279 microversion: 2.1 time: 0.254008 Oct 04 14:32:15.800775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 184/392] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:15 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:15.967716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:15.981962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3f0b74f1-eff7-44a9-a2aa-3a67898c881e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.305045 Oct 04 14:32:15.983090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 209/393] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:15 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:16.409731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:16.410787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:16.418882 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.419397 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.419823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.420998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.421474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.421906 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.554211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:16.555042 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:16.568134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.568863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.569637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.570518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.571113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.571692 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.635133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:16.656533 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ea891d6e-fb07-43e2-87e2-608630dbf8d4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.252514 Oct 04 14:32:16.661000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 185/394] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:16 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:16.667585 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:16.668652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:16.686957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:16.691390 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.692190 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.693440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.696098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.698855 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.702129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.719186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8b32d1ac-a5b1-4d13-8c65-a0366a6d85d1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1300 microversion: 2.1 time: 0.178053 Oct 04 14:32:16.740346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 210/395] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:16 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:16.811625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:16.812658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:16.843492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.846360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.846890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.847624 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:16.848102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:16.851610 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:16.991259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:17.007006 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:17.009676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:17.011173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-45318a38-b69b-44d4-be30-323d984544ac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.348816 Oct 04 14:32:17.025036 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 186/396] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:16 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:17.042563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:17.043436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:17.051183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:17.052144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:17.052823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:17.053804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:17.054671 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:17.055458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:17.089412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:17.098467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-59bef350-1133-444f-82e9-5febffa9a887 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1279 microversion: 2.1 time: 0.292025 Oct 04 14:32:17.128516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 211/397] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:16 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1279 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:17.297601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:17.306087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-62a1d730-2060-4b3a-9a9b-176e4f76c46a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1511 microversion: 2.1 time: 0.279601 Oct 04 14:32:17.307125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 187/398] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:17 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:17.707798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:17.709237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:17.716578 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:17.717421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:17.718056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:17.718988 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:17.719672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:17.720355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:17.754959 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:17.755657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:17.781494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:17.783895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:17.784363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:17.785102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:17.790044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:17.792630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.063672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:18.075997 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bb843736-80f9-4ed2-bd51-d937e11ef44f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.373840 Oct 04 14:32:18.076633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 212/399] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:17 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:18.082773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:18.083392 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:18.092580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:18.093736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:18.094386 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.095449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:18.096141 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:18.096836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.410418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:18.420168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:18.421786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:18.422982 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8e6cab08-301a-4729-847e-41d9da391162 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1745 microversion: 2.20 time: 0.345167 Oct 04 14:32:18.424033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 213/400] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:18 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1745 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:18.429590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:18.430202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:18.436665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:18.437212 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:18.437708 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.438418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:18.438866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:18.439586 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.546016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:18.565662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-73d1f3ed-49ed-4214-b5d1-a78ff8ab123d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1300 microversion: 2.1 time: 0.815785 Oct 04 14:32:18.566271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 188/401] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:17 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1300 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:18.572211 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:18.573121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:18.600460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:18.600977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:18.601423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.602148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:18.602615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:18.603040 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:18.699803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:18.709807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e7ea7fa4-5754-4f43-a052-ef8b2ef76577 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.284232 Oct 04 14:32:18.720772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 214/402] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:18 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:18.990155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:19.006608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6889733a-5107-4d0a-a0bd-77cb7c6c4391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1517 microversion: 2.1 time: 0.438469 Oct 04 14:32:19.007581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 189/403] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:18 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:19.106068 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:19.106725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:19.124165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.124704 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.125151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.125895 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.126356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.127660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.440665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:19.450521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:19.451483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:19.452485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3d31e34d-0309-4552-a104-ba16ec97cee5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.350836 Oct 04 14:32:19.453909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 215/404] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:19 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:19.461203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.470871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.471703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.472732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.474155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.474830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.594932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:19.597266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:19.620400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.620896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.621328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.622106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.622463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.637245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.734858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:19.745590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-39b51312-c4c3-4019-ab8d-4516394fec09 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1300 microversion: 2.1 time: 0.157381 Oct 04 14:32:19.746182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 216/405] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:19 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:19.762771 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:19.763774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:19.770398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.771068 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.771756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:19.773502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:19.774237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:19.775725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:20.050739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:20.055669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:20.072852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:20.074788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3572c904-392a-4e3c-9c57-fefb5a9b574e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.325308 Oct 04 14:32:20.075968 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 217/406] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:19 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:20.082469 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:20.084096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ede4aaba-f48f-4459-b35c-2d2fab6748ad tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1745 microversion: 2.20 time: 0.638455 Oct 04 14:32:20.098116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-f471ea53-ae63-4d9a-8cf5-5d882420ed74 req-aeff554b-e07d-4bc6-b5d2-7d2c73c67a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7710c92-4b84-4095-8986-a3bc34164760", "tag": "e54a5c10-31ed-49db-be6e-46142100601f"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:20.098646 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 190/407] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:19 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1745 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:20.115649 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-f471ea53-ae63-4d9a-8cf5-5d882420ed74 req-aeff554b-e07d-4bc6-b5d2-7d2c73c67a49 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:20.117240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-f471ea53-ae63-4d9a-8cf5-5d882420ed74 req-aeff554b-e07d-4bc6-b5d2-7d2c73c67a49 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:20.117898 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-f471ea53-ae63-4d9a-8cf5-5d882420ed74 req-aeff554b-e07d-4bc6-b5d2-7d2c73c67a49 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:20.149646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-f471ea53-ae63-4d9a-8cf5-5d882420ed74 req-aeff554b-e07d-4bc6-b5d2-7d2c73c67a49 service nova] Creating event network-changed:e54a5c10-31ed-49db-be6e-46142100601f for instance e7710c92-4b84-4095-8986-a3bc34164760 on hv-cinder-86026 Oct 04 14:32:20.155562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-f471ea53-ae63-4d9a-8cf5-5d882420ed74 req-aeff554b-e07d-4bc6-b5d2-7d2c73c67a49 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078109 Oct 04 14:32:20.156276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 218/408] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:20.481772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:20.482426 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:20.501595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:20.502443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:20.503004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:20.503753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:20.504258 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:20.514465 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:20.773104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:20.774884 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:20.789451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:20.791553 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:20.792224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:20.793170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:20.793826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:20.794366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:20.979560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:20.993455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2be98560-dbad-43bf-927f-7767e19b7223 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.225831 Oct 04 14:32:20.997122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 219/409] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:20 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:21.081517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:21.094833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6efa5fc1-fc30-4ccc-ae19-34a9616973ed tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.619294 Oct 04 14:32:21.117964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:21.118924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:21.124235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 191/410] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:20 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:21.133206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:21.134264 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:21.135145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:21.136233 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:21.137010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:21.137399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:21.137639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:21.138260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:21.149828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:21.150337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:21.150778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:21.151511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:21.152033 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:21.152424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:21.354739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:21.374216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:21.377358 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:21.379836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2c8635ba-acb3-4c92-8096-1d4442366063 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1745 microversion: 2.20 time: 0.265780 Oct 04 14:32:21.381538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 220/411] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:21 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1745 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:21.507617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:21.526608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bb176e5f-4734-47b6-9f3a-cf65b6691f4b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.401145 Oct 04 14:32:21.527212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 192/412] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:21 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:22.018471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:22.019081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:22.034331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.035254 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.035937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.036927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.037684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.038518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.123974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:22.125392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:22.133302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.133945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.134574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.135332 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.135795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.136227 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.225183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:22.234756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e323ce06-e47b-46d0-9480-e99cfdbc82bf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.220655 Oct 04 14:32:22.236526 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 221/413] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:22 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:22.242615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-47e3f01b-a4bf-483f-82d2-0d4b6897ba98 req-edd6cdb2-d267-4eb4-9911-ec1418954356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e321c8-c06c-4113-a76d-21aa1a27946f", "tag": "ae758bb2-370d-4f68-a541-62eb3b42c185"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:22.256097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-47e3f01b-a4bf-483f-82d2-0d4b6897ba98 req-edd6cdb2-d267-4eb4-9911-ec1418954356 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.260864 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-47e3f01b-a4bf-483f-82d2-0d4b6897ba98 req-edd6cdb2-d267-4eb4-9911-ec1418954356 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.261198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-47e3f01b-a4bf-483f-82d2-0d4b6897ba98 req-edd6cdb2-d267-4eb4-9911-ec1418954356 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.283567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-47e3f01b-a4bf-483f-82d2-0d4b6897ba98 req-edd6cdb2-d267-4eb4-9911-ec1418954356 service nova] Creating event network-changed:ae758bb2-370d-4f68-a541-62eb3b42c185 for instance 08e321c8-c06c-4113-a76d-21aa1a27946f on hv-cinder-86026 Oct 04 14:32:22.302612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-47e3f01b-a4bf-483f-82d2-0d4b6897ba98 req-edd6cdb2-d267-4eb4-9911-ec1418954356 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063660 Oct 04 14:32:22.306085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 222/414] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:22.335530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:22.344558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9e9c3757-1aed-4ef7-ae99-cf4db66c0e58 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.224994 Oct 04 14:32:22.345707 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 193/415] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:22 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:22.415115 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:22.415833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:22.422575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.423052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.424232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.424973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.425427 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.425854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.551591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:22.552318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:22.558907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.559742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.560540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.561485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:22.562141 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:22.563050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:22.603127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:22.613732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:22.627594 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:22.630676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:22.632960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9c68a5c8-597f-47f3-afa7-fb1fcf4503c3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1745 microversion: 2.20 time: 0.221858 Oct 04 14:32:22.634193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 223/416] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:22 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:22.739124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:22.749401 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5b29b6f7-e744-44be-a2dc-a3e908ea275d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.202209 Oct 04 14:32:22.764749 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 194/417] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:22 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:23.272234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:23.273814 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:23.281477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.282576 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.283321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.284202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.285057 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.286038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.373117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:23.374370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:23.393644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.397370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.398840 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.399947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.402490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.403233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.530995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:23.548608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b612ea6f-3fe4-4430-ac97-542cf8cfc813 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.275855 Oct 04 14:32:23.549432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 224/418] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:23 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:23.619800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:23.630889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-59306f93-216d-486d-9a6d-bbbf67c4defc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.262913 Oct 04 14:32:23.631568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 195/419] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:23 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:23.680054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:23.681780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:23.701481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.703182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.707872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.710070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.711603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.712417 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.789161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:23.789759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:23.807635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.808178 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.808656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.809392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:23.811705 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:23.815589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:23.994798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:24.010615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:24.019320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:24.023900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-59b80a6d-8c58-47b8-9ed0-f0a7b69e3460 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1745 microversion: 2.20 time: 0.350326 Oct 04 14:32:24.024540 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 225/420] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:23 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1745 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:24.193742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-3cc6987f-d35a-4f8b-9e43-d643caf930a4 req-83c8f4fe-8816-4a57-a6d8-87bfa50c0b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "name": "network-vif-plugged", "status": "completed", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:24.215672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-3cc6987f-d35a-4f8b-9e43-d643caf930a4 req-83c8f4fe-8816-4a57-a6d8-87bfa50c0b26 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:24.216157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-3cc6987f-d35a-4f8b-9e43-d643caf930a4 req-83c8f4fe-8816-4a57-a6d8-87bfa50c0b26 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:24.216611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-3cc6987f-d35a-4f8b-9e43-d643caf930a4 req-83c8f4fe-8816-4a57-a6d8-87bfa50c0b26 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:24.236342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:24.247907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-65fdbc3c-37ce-4c4a-be52-0e63c2bee5ab tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.477718 Oct 04 14:32:24.249923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 196/421] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:23 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:24.277977 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-3cc6987f-d35a-4f8b-9e43-d643caf930a4 req-83c8f4fe-8816-4a57-a6d8-87bfa50c0b26 service nova] Creating event network-vif-plugged:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:32:24.284758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-3cc6987f-d35a-4f8b-9e43-d643caf930a4 req-83c8f4fe-8816-4a57-a6d8-87bfa50c0b26 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094033 Oct 04 14:32:24.286292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 226/422] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:24.571770 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:24.573008 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:24.587025 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:24.590309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:24.596567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:24.597597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:24.598223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:24.598812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:24.629434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:24.657300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:24.659206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:24.667395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:24.668595 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:24.669317 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:24.670321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:24.670973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:24.671709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:24.897506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:24.919103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-21ccd3bd-623e-4643-a140-2dbde92ec97d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.268099 Oct 04 14:32:24.926561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 227/423] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:24 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:25.063151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:25.063834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:25.108196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:25.111356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:25.116953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:25.118218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:25.126225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:25.129560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:25.484226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:25.500956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5330e1cd-955a-4ea6-a7d0-3cf64b45c713 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.930397 Oct 04 14:32:25.505266 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 197/424] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:24 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:25.542575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-06a97580-41f1-4326-babb-49170677c14b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'create', calling method: .version_select at 0x7f571883a820>, body: {"keypair": {"name": "tempest-keypair-271316991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS84GOPujpS4J+6dmDexmuIiMxESl+orFqeTJSDum17agTYOHK5NEkN7bDHDTBETwf6unn6aHvwhKzNaUhqW1KUic23ovAj70GkA4Z+pnCXzKJi9QQrZ8OaYLFBVn66Vg=="}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:25.600295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-06a97580-41f1-4326-babb-49170677c14b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:32:25.612913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-06a97580-41f1-4326-babb-49170677c14b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for user 2b4c980bac3e444faa0e6f1a1d270cfa and project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'key_pairs'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:32:25.623816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:25.645111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:25.647234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:25.651683 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-54a7007d-a014-46fc-9624-61f131748122 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.592387 Oct 04 14:32:25.661043 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 228/425] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:25 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:25.669647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:25.681816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:25.693482 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:25.696770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:25.697618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:25.702623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-06a97580-41f1-4326-babb-49170677c14b tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194273 Oct 04 14:32:25.703899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:25.711377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:25.711924 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 198/426] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:32:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:25.712622 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:25.955926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:25.956762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:25.987159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:25.993095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:25.994192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:25.999890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:26.000540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:26.007511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:26.330935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:26.350978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2dce4751-9de2-4660-8070-af23ab79888d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.687987 Oct 04 14:32:26.352181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 229/427] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:25 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:26.477502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:26.491610 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fa506647-0962-44aa-a761-c7f512e8e42d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.544071 Oct 04 14:32:26.503064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 199/428] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:25 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:26.527781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:26.529848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:26.548029 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:26.548440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:26.550515 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:26.552268 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:26.560504 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:26.561340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:26.687533 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:26.688236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:26.702828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:26.703315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:26.703758 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:26.722235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:26.724861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:26.726971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:27.058187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:27.092417 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d4edbe69-edfc-469a-baac-332809250858 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.568527 Oct 04 14:32:27.093430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 230/429] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:26 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:27.380112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:27.381051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:27.397934 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:27.398838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:27.399532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:27.400629 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:27.401338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:27.405537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:27.708708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:27.718999 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:27.721042 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:27.722303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1359f192-ae9a-480c-9d0e-4d2d6cd7c23c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 1.038836 Oct 04 14:32:27.738276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 200/430] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:26 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:27.747999 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:27.757315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:27.768253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:27.773082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:27.773838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:27.775119 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:27.776899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:27.783712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:28.055476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:28.066538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-22b83824-f2fa-41e0-a856-e58187e55279 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.690967 Oct 04 14:32:28.085351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 231/431] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:27 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:28.122618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:28.123536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:28.139938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:28.140476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:28.140928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:28.141655 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:28.142432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:28.142876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:28.224714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:28.234762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-918995b1-e074-4aa6-8023-51073ba0748e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.494951 Oct 04 14:32:28.239237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 201/432] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:27 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:28.765506 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:28.767164 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:28.785583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:28.786469 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:28.787090 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:28.788000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:28.788666 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:28.789250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:28.993875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:29.024799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ba74dd3d-92a7-438a-b467-8e005445f844 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.905974 Oct 04 14:32:29.028497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 232/433] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:28 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:29.102901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:29.108490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:29.140287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:29.144910 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:29.145708 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:29.147830 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:29.148746 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:29.150736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:29.196018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:29.221646 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:29.231470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:29.242801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dcc2d1fa-5d1f-4f96-81c9-2ee85402c451 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.485558 Oct 04 14:32:29.243970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 202/434] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:28 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:29.268990 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:29.269915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:29.300612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:29.305461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:29.306669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:29.312229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:29.313801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:29.314602 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:29.666875 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:29.685781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-abf367f8-6199-4d66-84a3-f3102ee0facb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1701 microversion: 2.1 time: 0.421859 Oct 04 14:32:29.687317 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 203/435] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:29 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1701 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:29.724123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8de338e3-c42a-487f-8639-184aa3f3778f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:29.745043 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:29.750319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8de338e3-c42a-487f-8639-184aa3f3778f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:29.752024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8de338e3-c42a-487f-8639-184aa3f3778f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:29.752937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8de338e3-c42a-487f-8639-184aa3f3778f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:29.898043 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8de338e3-c42a-487f-8639-184aa3f3778f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Going to try to start instance {{(pid=120820) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 14:32:29.921373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:29.979995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c783f1ab-a956-44a3-b38d-a81bc2f37ca5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.878989 Oct 04 14:32:29.984529 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 233/436] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:29 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:30.056969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:30.058038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:30.072476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:30.076343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:30.077459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:30.082912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:30.085925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:30.087734 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:30.106825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8de338e3-c42a-487f-8639-184aa3f3778f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action" status: 202 len: 0 microversion: 2.1 time: 0.383388 Oct 04 14:32:30.112786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 204/437] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:32:29 2022] POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:32:30.141036 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:30.142562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:30.160004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:30.165249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:30.167346 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:30.169118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:30.169767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:30.178253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:30.417604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:30.430510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cd95f122-0d0e-4a97-aaab-1e71fd088bee tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.382774 Oct 04 14:32:30.431569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 234/438] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:30 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:30.447259 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:30.448157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:30.464191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:30.464715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:30.468466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:30.469341 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:30.477623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:30.478222 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:30.667306 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:30.685239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a4f07797-fb2f-4cc5-90c0-0a3813337d19 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1710 microversion: 2.1 time: 0.564567 Oct 04 14:32:30.700881 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 205/439] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:30 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1710 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:30.709403 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1729764841", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f70b9727-7199-4fe7-bb77-16baf61f7e49"}], "security_groups": [{"name": "tempest-securitygroup--1258383342"}], "key_name": "tempest-keypair-271316991", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:30.868006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:30.902433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:30.916214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:30.920056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ece7516d-4cd6-4c20-9ad7-674afb54037d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.487019 Oct 04 14:32:30.922366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 235/440] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:30 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:31.025706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:31.026562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:31.056654 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:31.061122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:31.061673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:31.062405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:31.062879 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:31.063302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:31.598471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:31.614647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d4bd15e8-c7f4-4bb8-bd06-d9d581a31b82 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.598561 Oct 04 14:32:31.619135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 236/441] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:31 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:31.624451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:31.625328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:31.655792 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:31.656811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:31.658431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:31.661570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:31.662498 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:31.663752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:31.993102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:32.006562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5ece54f7-2ed6-447d-9727-bfe704e90132 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.381938 Oct 04 14:32:32.022312 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 237/442] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:31 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:32.041521 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:32.042830 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:32.059305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:32.060342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:32.061231 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:32.061577 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:32.062048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:32.062488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:32.480126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:32.514217 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-af3d5b15-c9a6-4f75-887e-35f4f7192904 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1710 microversion: 2.1 time: 0.502958 Oct 04 14:32:32.514817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 238/443] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:32 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1710 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:32.531320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:32.535590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:32.555436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:32.555885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:32.556429 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:32.557159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:32.557614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:32.558193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:32.790808 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:32.802170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:32.806327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:32.809038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3fd39932-cd8f-480b-9091-57d38389d8f2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.292407 Oct 04 14:32:32.821365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 239/444] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:32 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:32.835975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:32.837011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:32.864154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:32.866239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:32.867758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:32.868604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:32.872930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:32.873447 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:33.333715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:33.364280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bc817ef1-4200-445f-94ef-8db4ae129764 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.540834 Oct 04 14:32:33.364934 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 240/445] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:32 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:33.380427 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:33.383312 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:33.414625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:33.418785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:33.421515 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:33.425531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:33.427602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:33.428278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:33.441054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:33.673662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:33.687672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1dd8614a-6722-42ee-8f54-07a9492d1900 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.321661 Oct 04 14:32:33.689418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 241/446] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:33 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:33.695938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:33.696846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:33.704227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:33.705410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:33.706116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:33.707132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:33.707807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:33.708585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:33.923541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:33.934569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5432495b-d865-448d-bb76-b0fb72f83a08 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1714 microversion: 2.1 time: 0.242846 Oct 04 14:32:33.935681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 242/447] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:33 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1714 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:33.961908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:33.962908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:33.971261 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:33.971930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:33.972476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:33.973305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:33.973879 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:33.974384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:34.419479 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:34.436475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:34.440882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:34.443490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9322e9b7-2a1a-4907-948d-d5cc8864ab0e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.489111 Oct 04 14:32:34.446220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 243/448] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:33 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:34.469532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:34.470716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:34.483139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:34.483635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:34.484117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:34.484869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:34.485374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:34.486363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:34.868120 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:34.891202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a6ad14ae-27ec-4242-91bd-98c64ad4072d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.441247 Oct 04 14:32:34.892265 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 244/449] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:34 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:34.898508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:34.907610 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:34.922468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:34.927152 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:34.930351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:34.939652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:34.942132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:34.942697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:34.943220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:35.654391 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:35.856573 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:35.868832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8c3ae905-83ad-4b0f-ae91-5ed8dfc5e228 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.973735 Oct 04 14:32:35.885118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 245/450] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:34 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:35.894612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-aef7c93d-40fa-4214-925e-dc84e534fc78 req-19c0d748-736a-44f5-a087-862173662d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e321c8-c06c-4113-a76d-21aa1a27946f", "name": "network-vif-plugged", "status": "completed", "tag": "ae758bb2-370d-4f68-a541-62eb3b42c185"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:35.910914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-aef7c93d-40fa-4214-925e-dc84e534fc78 req-19c0d748-736a-44f5-a087-862173662d32 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:35.911703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-aef7c93d-40fa-4214-925e-dc84e534fc78 req-19c0d748-736a-44f5-a087-862173662d32 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:35.912141 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-aef7c93d-40fa-4214-925e-dc84e534fc78 req-19c0d748-736a-44f5-a087-862173662d32 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:35.924567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-aef7c93d-40fa-4214-925e-dc84e534fc78 req-19c0d748-736a-44f5-a087-862173662d32 service nova] Creating event network-vif-plugged:ae758bb2-370d-4f68-a541-62eb3b42c185 for instance 08e321c8-c06c-4113-a76d-21aa1a27946f on hv-cinder-86026 Oct 04 14:32:35.932082 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-aef7c93d-40fa-4214-925e-dc84e534fc78 req-19c0d748-736a-44f5-a087-862173662d32 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045026 Oct 04 14:32:35.934243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 246/451] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:35.944551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:35.946251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:35.958927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:35.968090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:35.969460 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:35.971508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:35.972602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:35.973628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:36.323229 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:36.357847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:36.362955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:36.370626 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-828fc0f7-e42f-45c7-bcc7-072b23afab32 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.434577 Oct 04 14:32:36.374775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 247/452] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:35 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:36.382975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:36.400896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:36.419859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:36.428410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:36.429506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:36.435053 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:36.437039 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:36.441667 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:36.702341 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:36.722011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d95988ba-b759-4f54-8fc2-3ed527fa191b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.345813 Oct 04 14:32:36.736826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 248/453] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:36 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:36.901810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:36.903257 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:36.931862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:36.932720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:36.933770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:36.934729 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:36.935389 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:36.936677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:37.221625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:37.237678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f2924a20-7272-42ff-b828-9801ea03b011 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.342041 Oct 04 14:32:37.239643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 249/454] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:36 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:37.420980 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:37.423605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:37.436330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:37.437163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:37.437869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:37.439605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:37.440344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:37.440948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:37.861983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:37.892237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:37.907572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:37.909355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-28728d20-fee5-4807-8035-4f7b4efe216a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.506628 Oct 04 14:32:37.914530 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 250/455] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:37 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:37.925373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:37.928633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:37.959753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:37.961006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:37.961554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:37.962801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:37.964205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:37.965242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:38.247058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:38.274075 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e58e0567-d5c0-409c-a321-b3c14bc8ab08 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.357987 Oct 04 14:32:38.274900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 251/456] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:37 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:38.293024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:38.297338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:38.324272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:38.326865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:38.327572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:38.332117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:38.337237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:38.340356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:38.609238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:38.622611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ba52cac9-c505-4305-910d-7c78ff75ad13 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1367 microversion: 2.1 time: 0.345886 Oct 04 14:32:38.623907 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 252/457] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:38 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:38.637170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-6a2769f2-1281-499c-b816-84ea8cb99a93 req-266f060b-6bb2-4483-a4b9-237a730e8466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7710c92-4b84-4095-8986-a3bc34164760", "name": "network-vif-plugged", "status": "completed", "tag": "e54a5c10-31ed-49db-be6e-46142100601f"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:38.669167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-6a2769f2-1281-499c-b816-84ea8cb99a93 req-266f060b-6bb2-4483-a4b9-237a730e8466 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:38.669742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-6a2769f2-1281-499c-b816-84ea8cb99a93 req-266f060b-6bb2-4483-a4b9-237a730e8466 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:38.670151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-6a2769f2-1281-499c-b816-84ea8cb99a93 req-266f060b-6bb2-4483-a4b9-237a730e8466 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:38.701917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-6a2769f2-1281-499c-b816-84ea8cb99a93 req-266f060b-6bb2-4483-a4b9-237a730e8466 service nova] Creating event network-vif-plugged:e54a5c10-31ed-49db-be6e-46142100601f for instance e7710c92-4b84-4095-8986-a3bc34164760 on hv-cinder-86026 Oct 04 14:32:38.719232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-6a2769f2-1281-499c-b816-84ea8cb99a93 req-266f060b-6bb2-4483-a4b9-237a730e8466 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085332 Oct 04 14:32:38.724569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 253/458] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:32:38.972873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:38.976917 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:38.985076 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:38.986677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:38.987339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:38.989353 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:38.991718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:38.992936 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:39.446340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:39.461340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:39.463280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:39.464802 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b670d174-07d5-4067-837b-8ff76103f904 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.516520 Oct 04 14:32:39.485324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 254/459] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:38 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:39.491245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:39.491969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:39.499057 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:39.499620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:39.500067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:39.501069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:39.501795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:39.502297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:39.799930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:39.811988 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2e335988-cc4c-432d-b68c-b6647c226d43 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.325423 Oct 04 14:32:39.814975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 255/460] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:39 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:39.832998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:39.834065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:39.850570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:39.851434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:39.852249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:39.853256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:39.854034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:39.856346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:40.168681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:40.180604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3caf5055-d9c8-47e2-aa54-023b4c633ff7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1556 microversion: 2.1 time: 0.362722 Oct 04 14:32:40.181858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 256/461] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:39 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1556 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:40.209523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:40.210720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:40.222696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:40.223578 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:40.224565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:40.226132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:40.226918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:40.227765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:40.374783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a76bb6fd-c318-415a-ae89-e901f66dcf9e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172361 Oct 04 14:32:40.384959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 257/462] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:32:40 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:40.496155 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:40.497317 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:40.515508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:40.516406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:40.517232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:40.518593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:40.519347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:40.519946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:40.684443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:40.733385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=5 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:40.836364 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:40.872795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:40.883205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:40.891455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b204c3f5-90b4-4894-9fe1-2cfaee338666 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.402510 Oct 04 14:32:40.897493 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 258/463] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:40 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:40.906146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:40.912687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:40.924671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:40.929587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:40.930211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:40.935637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:40.935637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:40.935637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:41.000782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:41.227767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] validate_networks() for [('f70b9727-7199-4fe7-bb77-16baf61f7e49', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:32:41.403705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:41.423711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4f05c406-c04f-436e-8b87-f7427393b050 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1267 microversion: 2.1 time: 0.523852 Oct 04 14:32:41.424516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 259/464] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:40 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1267 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:41.926855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:41.928414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:41.971283 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:41.973201 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:41.977536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:41.979184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:41.979822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:41.982332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.329786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:42.340020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:42.347978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:42.353119 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c7ac99f5-fa24-4b9a-9d39-192d8860fbb2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.434359 Oct 04 14:32:42.354690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 260/465] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:41 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:42.462742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:42.464200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:42.486603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:42.490053 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:42.492829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.495236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:42.496916 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:42.498922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.717301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:32:42.718296 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:32:42.718938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:32:42.720114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:32:42.720915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:32:42.744972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:42.749812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:42.751089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.753305 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:42.754070 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:42.756941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.812700 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:32:42.819650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Getting quotas for user 2b4c980bac3e444faa0e6f1a1d270cfa and project ec24f1b720bd42ebb37a36d65757aacd. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:32:42.836253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:32:42.847944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:32:42.853216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:42.864218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ba4f43b6-fc95-4e0b-84ba-cd5bea7521fd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1454 microversion: 2.1 time: 0.413750 Oct 04 14:32:42.865503 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 261/466] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:42 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1454 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:42.891541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:42.894054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:42.908992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:42.910088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:42.912068 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.913341 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:42.914150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:42.915321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:42.979624 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fdd828d2-0ffe-4438-8b88-439ac4beb7b9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.277454 Oct 04 14:32:42.988808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 206/467] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:32:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 12279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:32:42.997782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4108df3f-3fff-48ee-82b9-5567597d9e24 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:42.998530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4108df3f-3fff-48ee-82b9-5567597d9e24 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:43.278114 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:43.307551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-40ad0696-4b68-4188-8b10-76b053627bec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1454 microversion: 2.1 time: 0.422095 Oct 04 14:32:43.322727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4108df3f-3fff-48ee-82b9-5567597d9e24 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:43.338913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 262/468] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:42 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1454 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:43.365690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4108df3f-3fff-48ee-82b9-5567597d9e24 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1245 microversion: 2.1 time: 0.344958 Oct 04 14:32:43.380919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 207/469] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:42 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1245 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:43.384206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:43.385164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:43.411888 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-e048e2f7-95ca-4334-b69d-3c46e752160c req-ade58c18-a9cf-42e1-a26d-f9223d3b3f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e321c8-c06c-4113-a76d-21aa1a27946f", "tag": "ae758bb2-370d-4f68-a541-62eb3b42c185"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:43.417457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:43.418828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:43.419674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:43.421748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:43.427205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:43.428380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:43.459240 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e048e2f7-95ca-4334-b69d-3c46e752160c req-ade58c18-a9cf-42e1-a26d-f9223d3b3f88 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:43.465283 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e048e2f7-95ca-4334-b69d-3c46e752160c req-ade58c18-a9cf-42e1-a26d-f9223d3b3f88 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:43.471585 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e048e2f7-95ca-4334-b69d-3c46e752160c req-ade58c18-a9cf-42e1-a26d-f9223d3b3f88 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:43.520667 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-e048e2f7-95ca-4334-b69d-3c46e752160c req-ade58c18-a9cf-42e1-a26d-f9223d3b3f88 service nova] Creating event network-changed:ae758bb2-370d-4f68-a541-62eb3b42c185 for instance 08e321c8-c06c-4113-a76d-21aa1a27946f on hv-cinder-86026 Oct 04 14:32:43.545551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-e048e2f7-95ca-4334-b69d-3c46e752160c req-ade58c18-a9cf-42e1-a26d-f9223d3b3f88 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138910 Oct 04 14:32:43.546165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 208/470] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:44.072279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:44.089228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:44.094618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:44.096530 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8c172f50-f80c-46df-bd7b-0807f058beaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.716223 Oct 04 14:32:44.097093 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 263/471] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:43 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:44.396970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:44.397697 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:44.427521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:44.431101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:44.432360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:44.436482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:44.437414 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:44.438245 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:44.627724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:44.653604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-722d850c-4bee-4853-98eb-cfc86418c6e0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1241 microversion: 2.1 time: 0.250223 Oct 04 14:32:44.658603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 209/472] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:44 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1241 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:45.131051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:45.131783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:45.143793 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:45.149290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:45.150279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:45.151276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:45.152475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:45.154929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:45.632905 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:45.642185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:45.646787 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:45.648460 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2e558d64-7e4c-4d7e-9097-4c037d165cdd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.523252 Oct 04 14:32:45.649782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 264/473] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:45 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:45.691429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:45.692068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:45.702985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:45.703627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:45.703976 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:45.704745 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:45.705197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:45.705609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:45.837456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:45.850299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bff5099d-2028-492a-8737-6108f7382ae9 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1297 microversion: 2.1 time: 0.166310 Oct 04 14:32:45.853801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 210/474] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:45 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1297 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:46.685567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:46.686309 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:46.696894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:46.697649 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:46.698534 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:46.699557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:46.700017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:46.700827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:46.880104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:46.880994 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:46.887048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:46.887555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:46.888021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:46.898046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:46.898585 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:46.899038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:46.951288 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:46.963996 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:46.965674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:46.966913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-37876317-563b-4746-aa49-03739ca06e13 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1740 microversion: 2.20 time: 0.287717 Oct 04 14:32:46.967715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 265/475] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:46 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:47.064052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:47.075102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3d9c4100-787b-4bf7-b346-b85f3c485f82 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1303 microversion: 2.1 time: 0.199132 Oct 04 14:32:47.082218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 211/476] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:46 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:47.342233 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-76847a30-afbf-4857-a07f-b355702d3f5b req-a7ac64a2-50ab-49e9-a28d-1ee5bfaf50cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7710c92-4b84-4095-8986-a3bc34164760", "tag": "e54a5c10-31ed-49db-be6e-46142100601f"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:47.354914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-76847a30-afbf-4857-a07f-b355702d3f5b req-a7ac64a2-50ab-49e9-a28d-1ee5bfaf50cc service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:47.355657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-76847a30-afbf-4857-a07f-b355702d3f5b req-a7ac64a2-50ab-49e9-a28d-1ee5bfaf50cc service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:47.356723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-76847a30-afbf-4857-a07f-b355702d3f5b req-a7ac64a2-50ab-49e9-a28d-1ee5bfaf50cc service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:47.371043 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-76847a30-afbf-4857-a07f-b355702d3f5b req-a7ac64a2-50ab-49e9-a28d-1ee5bfaf50cc service nova] Creating event network-changed:e54a5c10-31ed-49db-be6e-46142100601f for instance e7710c92-4b84-4095-8986-a3bc34164760 on hv-cinder-86026 Oct 04 14:32:47.378678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-76847a30-afbf-4857-a07f-b355702d3f5b req-a7ac64a2-50ab-49e9-a28d-1ee5bfaf50cc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039400 Oct 04 14:32:47.379953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 266/477] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:32:47.995903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:47.996525 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:48.008406 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:48.008929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:48.011743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:48.019517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:48.019517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:48.019517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:48.110956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:48.111886 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:48.121863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:48.122749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:48.123708 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:48.124735 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:48.125531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:48.126697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:48.285441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:48.303329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cd062a2e-1019-4cf6-a0ac-432a7cc15d66 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1303 microversion: 2.1 time: 0.200363 Oct 04 14:32:48.304692 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 267/478] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:48 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:48.724870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:48.741360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:48.746767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:48.751971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b9fd3c38-1ea9-40cf-946e-48f8fecdf445 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1722 microversion: 2.20 time: 0.760532 Oct 04 14:32:48.756760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 212/479] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:47 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1722 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:49.327132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:49.327867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:49.337395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:49.338366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:49.340805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:49.350502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:49.351367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:49.352048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:49.574776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:49.601061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f0297069-60ad-41da-9571-c45b22cd928d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.277686 Oct 04 14:32:49.602608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 268/480] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:49 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:49.787919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:49.788690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:49.798101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:49.799099 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:49.799575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:49.800690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:49.801674 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:49.802198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:49.965537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-98a77b59-e78b-4c04-b951-59b4ae88bc20 req-250ba9f6-82f2-4725-859b-5894af198e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302", "tag": "31660410-8845-41c4-b49c-b89043507bb3"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:49.976736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-98a77b59-e78b-4c04-b951-59b4ae88bc20 req-250ba9f6-82f2-4725-859b-5894af198e3a service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:49.977230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-98a77b59-e78b-4c04-b951-59b4ae88bc20 req-250ba9f6-82f2-4725-859b-5894af198e3a service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:49.977663 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-98a77b59-e78b-4c04-b951-59b4ae88bc20 req-250ba9f6-82f2-4725-859b-5894af198e3a service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:49.991959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-98a77b59-e78b-4c04-b951-59b4ae88bc20 req-250ba9f6-82f2-4725-859b-5894af198e3a service nova] Creating event network-changed:31660410-8845-41c4-b49c-b89043507bb3 for instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 on hv-cinder-86026 Oct 04 14:32:49.997397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-98a77b59-e78b-4c04-b951-59b4ae88bc20 req-250ba9f6-82f2-4725-859b-5894af198e3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035791 Oct 04 14:32:49.998244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 269/481] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:32:50.037350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:50.046546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:50.048982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:50.050207 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1d5078a7-0b72-471c-bb51-fcf51083808e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1722 microversion: 2.20 time: 0.268810 Oct 04 14:32:50.050783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 213/482] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:49 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:50.426240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-42f36eb1-52bc-43de-a2b2-734a579cad7b req-c8a66682-7bce-4bb6-a8c6-a4e7ebd5d0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "name": "network-vif-unplugged", "status": "completed", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:50.439543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-42f36eb1-52bc-43de-a2b2-734a579cad7b req-c8a66682-7bce-4bb6-a8c6-a4e7ebd5d0cb service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:50.440033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-42f36eb1-52bc-43de-a2b2-734a579cad7b req-c8a66682-7bce-4bb6-a8c6-a4e7ebd5d0cb service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:50.440677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-42f36eb1-52bc-43de-a2b2-734a579cad7b req-c8a66682-7bce-4bb6-a8c6-a4e7ebd5d0cb service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:50.455182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-42f36eb1-52bc-43de-a2b2-734a579cad7b req-c8a66682-7bce-4bb6-a8c6-a4e7ebd5d0cb service nova] Creating event network-vif-unplugged:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:32:50.460535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-42f36eb1-52bc-43de-a2b2-734a579cad7b req-c8a66682-7bce-4bb6-a8c6-a4e7ebd5d0cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039499 Oct 04 14:32:50.461362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 270/483] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:32:50.627116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:50.627721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:50.633754 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:50.634233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:50.634663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:50.635351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:50.635795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:50.636211 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:50.783910 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:50.791962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-89979868-9357-4ed8-849f-042a8f7e1944 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.169585 Oct 04 14:32:50.792632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 214/484] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:50 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:32:50.794603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1237134601", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:51.078573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:51.079440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:51.087183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:51.087678 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:51.088118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:51.088858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:51.089319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:51.089743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:51.229792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:51.238311 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:51.239765 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:51.240948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-eb4a00c2-66ab-497e-b2fc-5bb63155f849 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1722 microversion: 2.20 time: 0.167630 Oct 04 14:32:51.241513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 215/485] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:51 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:51.815671 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:51.817206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:51.823917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:51.824456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:51.824902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:51.825618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:51.826075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:51.826502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:52.018379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:52.027859 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d756e26f-6f0e-4c1d-b99d-9282a61c106c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.216249 Oct 04 14:32:52.028751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 216/486] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:51 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:52.268614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:52.269148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:52.275970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:52.276484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:52.276914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:52.277614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:52.278093 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:52.278506 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:52.540672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:52.552702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:52.555147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:52.556499 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c02cd744-eca9-4a07-aa91-9618aea4d29f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1665 microversion: 2.20 time: 0.293137 Oct 04 14:32:52.557347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 217/487] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:52 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1665 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:52.583329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20eaef44-546c-49f1-b9f7-3a87080cfcb3"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:52.585891 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:52.593171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:52.593673 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:52.594864 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:52.595657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:52.596125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:52.596584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:52.782550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:52.987713 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fe924b96-4f16-473b-bee4-1044baaf13b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.409062 Oct 04 14:32:52.988501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 218/488] 10.222.0.64 () {62 vars in 1364 bytes} [Tue Oct 4 14:32:52 2022] POST /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments => generated 188 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 14:32:53.057583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:53.058309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:53.066710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:53.067252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:53.067655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:53.068413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:53.068886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:53.069315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:53.210403 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:53.218299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-297f7e84-c2f1-46f4-9bc5-338e409b04d7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.164476 Oct 04 14:32:53.218920 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 219/489] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:53 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:53.224472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:53.225054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:53.231367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:53.231854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:53.232281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:53.232996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:53.233439 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:53.233850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:53.283497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120820) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 14:32:53.333155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=8 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:53.356829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-82bf786e-ba2a-441c-acb6-589ff33d55fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/action" status: 202 len: 0 microversion: 2.20 time: 0.136072 Oct 04 14:32:53.357629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 220/490] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Oct 4 14:32:53 2022] POST /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:32:53.366171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:53.366783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:53.374667 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:53.376002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:53.376497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:53.377216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:53.377678 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:53.378113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:53.383591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:32:53.529470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:53.542474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:53.544878 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:53.546795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3e637bdd-1861-497c-a7aa-e1c6666b2688 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.184309 Oct 04 14:32:53.548582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 221/491] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:53 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:54.240766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:54.241453 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:54.247337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:54.247820 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:54.248264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:54.248970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:54.249427 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:54.249854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:54.385251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:54.392438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-afc25381-00b9-4bf9-a059-794dc5353120 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.155359 Oct 04 14:32:54.393110 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 222/492] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:54 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:54.578031 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:54.579196 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:54.587588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:54.588116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:54.588575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:54.589292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:54.589745 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:54.590168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:54.742154 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:54.751289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:54.752783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:54.753996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2a715357-d200-41b0-92de-d477f3fa71b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.182360 Oct 04 14:32:54.754577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 223/493] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:54 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:32:55.415460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:55.416114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:55.423589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:55.424076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:55.424658 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:55.425443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:55.425870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:55.426308 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:55.569479 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:55.579030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1bf1e9f3-b690-4e13-baa2-6b76226b4bb6 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.166949 Oct 04 14:32:55.579633 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 224/494] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:55 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:55.779986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:55.780617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:55.788132 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:55.788637 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:55.789068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:55.789774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:55.790223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:55.790642 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:55.943085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:55.953282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:55.955515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:55.956759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4bdb9dac-9ff3-4283-8239-899c9a369178 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.180636 Oct 04 14:32:55.957331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 225/495] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:55 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:56.544521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-81a23ecd-c006-4d01-b323-642885ee2483 req-aa21f0af-8375-4652-9442-7ec30c8eee4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302", "name": "network-vif-plugged", "status": "completed", "tag": "31660410-8845-41c4-b49c-b89043507bb3"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:32:56.562309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-81a23ecd-c006-4d01-b323-642885ee2483 req-aa21f0af-8375-4652-9442-7ec30c8eee4e service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:56.563119 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-81a23ecd-c006-4d01-b323-642885ee2483 req-aa21f0af-8375-4652-9442-7ec30c8eee4e service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:56.563387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-81a23ecd-c006-4d01-b323-642885ee2483 req-aa21f0af-8375-4652-9442-7ec30c8eee4e service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:56.575950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-81a23ecd-c006-4d01-b323-642885ee2483 req-aa21f0af-8375-4652-9442-7ec30c8eee4e service nova] Creating event network-vif-plugged:31660410-8845-41c4-b49c-b89043507bb3 for instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 on hv-cinder-86026 Oct 04 14:32:56.581314 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-81a23ecd-c006-4d01-b323-642885ee2483 req-aa21f0af-8375-4652-9442-7ec30c8eee4e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043729 Oct 04 14:32:56.581987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 226/496] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:32:56.603222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:56.603924 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:56.611635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:56.611839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:56.612417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:56.613154 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:56.613605 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:56.614256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:56.768158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:56.780565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1900d2b2-cc11-4d96-ae0c-362aaa947da0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.181462 Oct 04 14:32:56.781440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 227/497] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:56 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:56.983818 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:56.985123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:56.992431 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:56.993060 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:56.993650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:56.994711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:56.995174 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:56.995768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:57.134618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:57.144014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:57.145527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:57.146696 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cb02d397-9071-4f0e-9558-5874338353c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.167113 Oct 04 14:32:57.147256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 228/498] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:56 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:57.805489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:57.806161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:57.812832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:57.813321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:57.814292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:57.815001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:57.815459 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:57.815887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:57.959199 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:57.966936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d92f1105-0905-47a7-b6d9-3f940b7ab2d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1371 microversion: 2.1 time: 0.165816 Oct 04 14:32:57.967511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 229/499] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:57 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:58.175133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:58.175941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:58.182895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:58.183468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:58.183948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:58.184782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:58.185287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:58.185750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:58.325684 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:58.343926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:58.348514 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:58.349856 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-96f8a093-beaa-4594-918e-31ecef6c8b26 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.181391 Oct 04 14:32:58.350413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 230/500] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:58 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:32:58.989971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:58.990644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:58.997306 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:58.997782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:58.998235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:58.998928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:58.999377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:58.999787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:59.144906 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:59.153122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a4e0e065-f8e7-446b-a7d4-ee503c7db0f3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1566 microversion: 2.1 time: 0.166826 Oct 04 14:32:59.153887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 231/501] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:32:58 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:32:59.177577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:59.178060 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:59.183979 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:59.184504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:59.184930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:59.185623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:59.186065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:59.186476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:59.268836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7e789707-f718-44a5-bca9-3ed0e778f993 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095020 Oct 04 14:32:59.269432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 232/502] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:32:59 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:32:59.374985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:32:59.375595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:32:59.382962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:59.383617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:59.383972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:59.384985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:32:59.385177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:32:59.385616 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:32:59.647639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:59.657144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:59.658624 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:32:59.659813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d13ab576-e9a1-4683-b581-5746f704f909 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.288704 Oct 04 14:32:59.660393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 233/503] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:32:59 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:00.392623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-d37941d6-4b60-4e7b-b665-778fa4ad6146 req-91555772-c70e-4415-ab26-9e66bcbbd336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302", "tag": "31660410-8845-41c4-b49c-b89043507bb3"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:00.404738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d37941d6-4b60-4e7b-b665-778fa4ad6146 req-91555772-c70e-4415-ab26-9e66bcbbd336 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:00.405465 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d37941d6-4b60-4e7b-b665-778fa4ad6146 req-91555772-c70e-4415-ab26-9e66bcbbd336 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:00.405949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d37941d6-4b60-4e7b-b665-778fa4ad6146 req-91555772-c70e-4415-ab26-9e66bcbbd336 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:00.420197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-d37941d6-4b60-4e7b-b665-778fa4ad6146 req-91555772-c70e-4415-ab26-9e66bcbbd336 service nova] Creating event network-changed:31660410-8845-41c4-b49c-b89043507bb3 for instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 on hv-cinder-86026 Oct 04 14:33:00.427825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-d37941d6-4b60-4e7b-b665-778fa4ad6146 req-91555772-c70e-4415-ab26-9e66bcbbd336 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038242 Oct 04 14:33:00.428584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 234/504] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:33:00.446238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=56 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:00.688588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:00.690932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:00.697982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:00.698626 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:00.699165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:00.699980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:00.701274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:00.701956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:00.805902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=53 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:00.881176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] validate_networks() for None {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:33:00.994256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:01.007342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:01.011539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:01.013018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-67d43cac-effe-42dc-9a02-f911305f672a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.329041 Oct 04 14:33:01.037887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 235/505] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:00 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:01.258710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:33:01.259131 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:33:01.259607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:33:01.260026 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:33:01.260623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:33:01.272849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:01.273252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:01.273689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:01.274517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:01.274984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:01.275414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:01.305727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Getting quotas for project f5980ace2a72461689bfb87d48571e72. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:33:01.310915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Getting quotas for user b03bae15d7bf43bb871c1a2eed6ae09a and project f5980ace2a72461689bfb87d48571e72. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:33:01.324937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:33:01.327648 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:33:01.388048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e6333787-4140-4172-96a0-702ec73aeeff tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.597842 Oct 04 14:33:01.389363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 271/506] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 10600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:33:01.401303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-04503c1b-f02c-4217-8df6-3e6479054e6b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:01.408605 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-04503c1b-f02c-4217-8df6-3e6479054e6b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:01.493914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-04503c1b-f02c-4217-8df6-3e6479054e6b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:01.503576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-04503c1b-f02c-4217-8df6-3e6479054e6b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1215 microversion: 2.1 time: 0.106802 Oct 04 14:33:01.517237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 236/507] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:01 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:02.043619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:02.044347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:02.051404 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:02.051898 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:02.052365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:02.053085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:02.053539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:02.053967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:02.217072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:02.226724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:02.228198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:02.229412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-794d8acb-7302-4add-88ec-acdb58cd5fd3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1751 microversion: 2.20 time: 0.190285 Oct 04 14:33:02.229975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 272/508] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:02 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:02.530186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:02.530829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:02.539265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:02.539761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:02.540198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:02.540940 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:02.541396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:02.541821 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:02.618789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:02.627432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-14f1d846-d7fe-46e0-bd59-191394700f78 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1267 microversion: 2.1 time: 0.101187 Oct 04 14:33:02.628024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 237/509] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:02 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:03.261065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:03.262484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:03.271933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:03.272620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:03.272936 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:03.273685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:03.275661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:03.275661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:03.428263 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:03.439151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:03.440892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:03.442297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c9629247-9057-4117-9cc2-3ba089228faf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1753 microversion: 2.20 time: 0.185831 Oct 04 14:33:03.442859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 273/510] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:03 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:33:03.651601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:03.652250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:03.665244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:03.667954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:03.668601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:03.670051 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:03.670688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:03.671430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:03.738279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:03.746155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a858df30-b9fa-4b96-97b2-fc4f9500a6bf tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1273 microversion: 2.1 time: 0.099099 Oct 04 14:33:03.746716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 238/511] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:03 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:04.471165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:04.471780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:04.477817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:04.478305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:04.478739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:04.479436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:04.479890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:04.480328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:04.620639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:04.629853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:04.631280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:04.632463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2a6b0202-c9f9-4382-85b0-fa2098ab4266 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.165304 Oct 04 14:33:04.633021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 274/512] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:04 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:04.770092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:04.770819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:04.777338 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:04.777931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:04.778430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:04.779199 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:04.779725 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:04.780215 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:05.107988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:05.122103 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-913b77db-8602-4fe7-86d3-26d6e37ad018 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.356077 Oct 04 14:33:05.122810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 239/513] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:04 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:05.660157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:05.660883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:05.667066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:05.667551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:05.667986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:05.668911 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:05.669575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:05.670229 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:05.819399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:05.829520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:05.831669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:05.832962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-644a7ff8-05c7-4be9-a298-310c9df51869 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.177869 Oct 04 14:33:05.833537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 275/514] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:05 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:06.087539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-1ef49f70-b6f6-4513-945c-9313c46c9b43 req-35e56a0b-edb8-461e-8ad2-f424120ce5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4dd528f-e488-458b-8ca2-d3e60e7993e9", "tag": "cc654320-9ffc-48fb-ad24-5ce6e03a6630"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:06.097609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-1ef49f70-b6f6-4513-945c-9313c46c9b43 req-35e56a0b-edb8-461e-8ad2-f424120ce5ce service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:06.098815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-1ef49f70-b6f6-4513-945c-9313c46c9b43 req-35e56a0b-edb8-461e-8ad2-f424120ce5ce service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:06.099270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-1ef49f70-b6f6-4513-945c-9313c46c9b43 req-35e56a0b-edb8-461e-8ad2-f424120ce5ce service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:06.113759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-1ef49f70-b6f6-4513-945c-9313c46c9b43 req-35e56a0b-edb8-461e-8ad2-f424120ce5ce service nova] Creating event network-changed:cc654320-9ffc-48fb-ad24-5ce6e03a6630 for instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 on hv-cinder-86026 Oct 04 14:33:06.119258 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-1ef49f70-b6f6-4513-945c-9313c46c9b43 req-35e56a0b-edb8-461e-8ad2-f424120ce5ce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035213 Oct 04 14:33:06.120719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 240/515] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:06.146441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:06.147198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:06.153167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:06.153644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:06.154074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:06.154766 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:06.155214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:06.155633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:06.309046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:06.318982 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-61a30487-0603-402a-be1f-8614dcc333dc tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.176922 Oct 04 14:33:06.320638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 276/516] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:06 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:06.874830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:06.876790 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:06.883791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:06.884285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:06.884748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:06.885496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:06.885953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:06.886407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:06.891874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:07.051072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:07.064834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:07.070766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:07.071995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b1cd1dc3-2e3b-4fb7-9619-77ea88a17ca7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.201842 Oct 04 14:33:07.072829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 241/517] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:06 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:07.342551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:07.343222 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:07.349163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:07.349642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:07.350133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:07.350828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:07.351273 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:07.351695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:07.522269 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:07.530461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d6bd50d9-d251-4353-bc16-31a4a2e11a8e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.191934 Oct 04 14:33:07.531036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 277/518] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:07 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:08.111886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:08.112788 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:08.122982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:08.123486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:08.124342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:08.125060 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:08.125584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:08.126540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:08.320710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:08.330685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:08.332404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:08.333577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f2d91caf-2bf3-4892-a0dd-24144bb912b2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.226307 Oct 04 14:33:08.334143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 242/519] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:08 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:08.556703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:08.558137 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:08.571497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:08.573006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:08.574811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:08.577352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:08.578031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:08.579863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:08.765441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:08.774070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-41446c6c-10cb-46fc-850f-98b30ea5a7e6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.223126 Oct 04 14:33:08.774643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 278/520] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:08 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:09.362300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:09.363736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:09.377808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:09.378306 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:09.378739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:09.379445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:09.380081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:09.380614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:09.550317 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:09.560010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:09.561511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:09.562663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-31a2f848-3014-4f7a-9d0e-98496fb950ee tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.206019 Oct 04 14:33:09.563274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 243/521] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:09 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:09.804652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:09.806090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:09.814477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:09.815293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:09.815938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:09.817078 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:09.817714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:09.818314 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:09.993320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:10.004130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1401925e-4e4b-4629-9724-795fe9c9125c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.206688 Oct 04 14:33:10.005024 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 279/522] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:09 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:10.589612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:10.590279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:10.592532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:10.598436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:10.598938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:10.599425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:10.600474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:10.600937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:10.601368 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:10.761649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:10.772776 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:10.774701 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:10.775898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-722724a9-a963-4bdb-a124-deb1ebb165af tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.190240 Oct 04 14:33:10.776569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 244/523] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:10 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:11.029454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:11.030111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:11.037335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:11.037915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:11.038409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:11.039171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:11.039685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:11.040171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:11.233384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:11.243908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a09c2b14-aa04-41a4-85a4-f54d0e8bb26e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.218453 Oct 04 14:33:11.244864 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 280/524] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:11 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:11.803676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:11.805039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:11.811275 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:11.814912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:11.815831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:11.816561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:11.831251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:11.832931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:11.833615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:11.996930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:12.006741 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:12.008230 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:12.009494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a9d9f22c-ae7e-4a4f-8ea9-3d05714337b1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.209975 Oct 04 14:33:12.010054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 245/525] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:11 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:33:12.267625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:12.268228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:12.273231 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:12.274388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=6 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:12.277587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:12.278085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:12.278517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:12.279433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:12.279900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:12.280343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:12.423748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:12.431932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4f485444-c5da-43b3-9d81-a48fa2b60c38 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.168120 Oct 04 14:33:12.432557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 281/526] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:12 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:13.035490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:13.036101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:13.051334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:13.051821 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:13.052260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:13.053010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:13.053461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:13.053885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:13.222746 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:13.233745 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:13.235241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:13.236456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-aeb1117b-593d-4a97-9929-5a46b981b4aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.205388 Oct 04 14:33:13.237324 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 246/527] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:13 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:13.464274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:13.465600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:13.475816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:13.476468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:13.476907 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:13.477822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:13.478315 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:13.478877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:13.671519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:13.679980 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7d9cd7ee-35df-4c11-8f0a-951684f68704 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.220579 Oct 04 14:33:13.680683 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 282/528] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:13 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:14.268468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:14.270573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:14.279831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:14.280508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:14.281195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:14.283044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:14.283676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:14.284181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:14.473183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:14.482446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:14.486222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:14.487798 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bda3c19d-11e3-4285-bb99-84dfb287a599 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.225049 Oct 04 14:33:14.501928 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 247/529] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:14 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:14.705371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:14.706306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:14.715220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:14.715767 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:14.716258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:14.716955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:14.717594 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:14.718205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:14.956266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:14.978126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-274ff263-59a8-43c2-9600-03990dd2491a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.274579 Oct 04 14:33:14.996365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 283/530] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:14 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:15.517113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:15.517926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:15.541966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:15.545339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:15.546177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:15.549204 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:15.550483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:15.551603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:15.748578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:15.759032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:15.760601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:15.762070 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-233d024e-a96b-4246-8835-8f9ebacfc97f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.249691 Oct 04 14:33:15.763250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 248/531] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:15 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:16.009340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:16.009983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:16.018477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:16.018947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:16.021093 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:16.025168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:16.025970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:16.026587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:16.233632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:16.242615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-963a6148-86ba-4af2-aff4-5b943247b4ef tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.237240 Oct 04 14:33:16.243811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 284/532] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:16 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:16.798673 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:16.800044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:16.808117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:16.809001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:16.809660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:16.810536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:16.811147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:16.811722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:17.087698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:17.103113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:17.106185 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:17.107441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5ccc491b-0ef8-43c0-9fa9-1d8805d63b45 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.318061 Oct 04 14:33:17.108028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 249/533] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:16 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:33:17.265374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:17.266020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:17.272158 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:17.272682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:17.273104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:17.273799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:17.274247 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:17.274664 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:17.407564 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:17.415251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b1ef0392-336a-4e89-8831-7dca017ca9df tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.153746 Oct 04 14:33:17.415833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 285/534] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:17 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:18.139499 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:18.140534 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:18.147551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:18.148059 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:18.148523 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:18.149244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:18.149704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:18.150131 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:18.293282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:18.302702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:18.304279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:18.305471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f46dc41a-0cb5-4a0e-ac5b-a5a663b359a3 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.169965 Oct 04 14:33:18.306039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 250/535] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:18 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:18.438678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:18.439925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:18.446033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:18.446570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:18.447034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:18.447735 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:18.448284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:18.448956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:18.591134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:18.600490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5c31c834-a99a-48d8-b2d0-aadec8df0128 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.165364 Oct 04 14:33:18.601117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 286/536] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:18 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:19.332041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:19.332694 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:19.339534 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:19.340128 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:19.340632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:19.341326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:19.341779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:19.342199 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:19.474970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:19.485573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:19.487066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:19.488240 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e05e6d8e-5236-42eb-9a4b-f6288d3538ea tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.161052 Oct 04 14:33:19.488835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 251/537] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:19 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:19.623698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:19.624332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:19.630593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:19.631060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:19.631489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:19.632180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:19.632668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:19.633094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:19.766126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:19.773889 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ee1194b0-b54e-4cca-83c3-cb142de5d59c tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.154107 Oct 04 14:33:19.774454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 287/538] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:19 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:20.513577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:20.514220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:20.521691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:20.522178 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:20.522613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:20.523321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:20.523774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:20.524205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:20.665241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:20.674903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:20.676394 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:20.677618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dd3ab09b-8ffe-43bb-a466-589fc1556478 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.167952 Oct 04 14:33:20.678185 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 252/539] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:20 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:20.797665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:20.798178 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:20.804819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:20.805299 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:20.805730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:20.806420 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:20.806870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:20.807291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:20.811340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:20.944507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:20.952339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-12db4e76-6a5c-4ef6-b9ae-d95f52a80393 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.158669 Oct 04 14:33:20.952922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 288/540] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:20 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:21.704333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:21.705509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:21.712143 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:21.712659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:21.713096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:21.713792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:21.714247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:21.714672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:21.848577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:21.857281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:21.858721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:21.859867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-16bbc86a-8740-4c35-a02d-587cb9c2e5b8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.159616 Oct 04 14:33:21.860440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 253/541] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:21 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:33:21.975409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:21.975970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:21.983178 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:21.983653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:21.984083 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:21.984792 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:21.985240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:21.985662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:22.115143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:22.123244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2086d7b4-a033-44af-a874-0ca709cfdb45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.151931 Oct 04 14:33:22.123813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 289/542] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:21 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:22.885832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:22.886421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:22.892600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:22.893233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:22.893665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:22.894356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:22.894801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:22.895217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:23.034587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:23.043077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:23.044557 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:23.045701 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-da254fbd-23fa-40c4-a2a3-c303f28845ef tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.163841 Oct 04 14:33:23.046252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 254/543] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:22 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:23.146968 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:23.147547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:23.154023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:23.154499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:23.154927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:23.155626 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:23.156051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:23.156508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:23.285041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:23.292775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b315dd06-b01a-4b37-aa74-245c5ff84e56 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.149704 Oct 04 14:33:23.293342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 290/544] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:23 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:24.071494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:24.072037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:24.078553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:24.079035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:24.079473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:24.080176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:24.080659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:24.081114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:24.211731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:24.221033 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:24.222557 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:24.223711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-eaa4b78b-bb1d-4bd0-84ea-47d637f5be72 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.156261 Oct 04 14:33:24.224274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 255/545] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:24 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:24.316139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:24.316771 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:24.322824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:24.323235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:24.323664 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:24.324366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:24.324820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:24.325235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:24.458555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:24.466380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e88889e8-06ac-4952-8c6c-29bed7f490c5 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.154430 Oct 04 14:33:24.466959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 291/546] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:24 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:25.249956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:25.250579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:25.257097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:25.257571 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:25.257995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:25.258680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:25.259122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:25.259539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:25.401462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:25.412264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:25.413767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:25.414976 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e496723f-9f56-4aa1-84d5-779b7428de30 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.168932 Oct 04 14:33:25.415499 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 256/547] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:25 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:25.490274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:25.491748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:25.498978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:25.499642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:25.500271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:25.501253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:25.502583 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:25.503055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:25.639180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:25.648777 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b43e1148-cfc0-4c3f-972d-fa81f5924b6e tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.162877 Oct 04 14:33:25.649358 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 292/548] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:25 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:26.441865 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:26.442477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:26.449789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:26.449993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:26.450332 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:26.451157 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:26.451696 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:26.452127 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:26.584084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:26.587814 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:26.594246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:26.595983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:26.597129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9364396d-2f9c-4615-aab3-f9be57ded831 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.159996 Oct 04 14:33:26.597681 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 257/549] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:26 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:26.683456 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:26.684009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:26.691090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:26.691943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:26.692441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:26.693143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:26.693600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:26.694021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:26.836130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:26.850027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c9e0f3e7-63f2-4b43-bf72-ccd00978201b tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.171410 Oct 04 14:33:26.850841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 293/550] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:26 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:27.623644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:27.624225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:27.631381 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:27.631852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:27.632279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:27.632987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:27.633430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:27.633846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:27.777193 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:27.790862 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:27.792731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:27.794430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4d01eb87-1e2b-4d88-9c51-9bcb6472d48a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.174709 Oct 04 14:33:27.795111 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 258/551] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:27 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:27.875180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:27.875848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:27.882870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:27.883890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:27.883890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:27.884518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:27.884973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:27.885398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:28.016118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:28.023992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c8d6e046-b41d-4e7d-b96d-941c7043dbf0 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.153462 Oct 04 14:33:28.024669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 294/552] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:27 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:28.820999 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:28.821529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:28.828204 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:28.828846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:28.829310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:28.830088 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:28.830546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:28.830967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:28.976952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:28.987053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:28.988778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:28.990121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a14ccb37-bc6d-4eaf-bfc9-c241a561023d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.173174 Oct 04 14:33:28.990746 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 259/553] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:28 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:29.051571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:29.052302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:29.058891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:29.059380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:29.059819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:29.060549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:29.061004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:29.061426 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:29.207206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:29.215239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e97b5cba-7e52-4f3f-8e84-fc6c993b8914 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.168167 Oct 04 14:33:29.215826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 295/554] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:29 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:30.016138 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:30.017523 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:30.024069 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:30.024592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:30.025021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:30.025726 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:30.026175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:30.026604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:30.160998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:30.170532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:30.172780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:30.175052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0f38ddfb-b899-446e-950f-1626b033de01 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.162646 Oct 04 14:33:30.176056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 260/555] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:30 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:30.239039 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:30.239622 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:30.245464 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:30.245941 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:30.246375 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:30.247064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:30.247512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:30.247929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:30.397163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:30.409135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-635cc31b-8b77-4551-a22f-e61924a69a42 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.174611 Oct 04 14:33:30.409727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 296/556] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:30 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:30.645254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-c36467ea-416c-45e4-ace7-987afcf3fcdc req-39ae8acd-a2ab-4c9f-a771-89e3ca11dcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dd528f-e488-458b-8ca2-d3e60e7993e9", "name": "network-vif-plugged", "status": "completed", "tag": "cc654320-9ffc-48fb-ad24-5ce6e03a6630"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:30.659039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c36467ea-416c-45e4-ace7-987afcf3fcdc req-39ae8acd-a2ab-4c9f-a771-89e3ca11dcc5 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:30.659533 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c36467ea-416c-45e4-ace7-987afcf3fcdc req-39ae8acd-a2ab-4c9f-a771-89e3ca11dcc5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:30.659987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c36467ea-416c-45e4-ace7-987afcf3fcdc req-39ae8acd-a2ab-4c9f-a771-89e3ca11dcc5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:30.676634 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-c36467ea-416c-45e4-ace7-987afcf3fcdc req-39ae8acd-a2ab-4c9f-a771-89e3ca11dcc5 service nova] Creating event network-vif-plugged:cc654320-9ffc-48fb-ad24-5ce6e03a6630 for instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 on hv-cinder-86026 Oct 04 14:33:30.688114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-c36467ea-416c-45e4-ace7-987afcf3fcdc req-39ae8acd-a2ab-4c9f-a771-89e3ca11dcc5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048209 Oct 04 14:33:30.689225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 261/557] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:31.206157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:31.206772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:31.208699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:31.215252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:31.216066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:31.216719 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:31.217290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:31.217733 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:31.218144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:31.410358 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:31.421773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:31.423685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:31.424934 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e9bc1d75-ff30-4c2e-850a-3612f8532e9d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.224358 Oct 04 14:33:31.427220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 297/558] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:31 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:31.435689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:31.438583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:31.446024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:31.447189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:31.448120 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:31.449252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:31.450596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:31.453290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:31.658996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:31.672777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cd108d90-2dd4-4048-b6cf-4738f8ffd7cb tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.241536 Oct 04 14:33:31.679380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 262/559] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:31 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:32.462808 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:32.463873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:32.473785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:32.475104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:32.475891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:32.477189 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:32.478063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:32.478846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:32.674843 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:32.684471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:32.686075 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:32.687387 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-67254dff-f59e-4861-9ad9-f705da5a5fb5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.229666 Oct 04 14:33:32.688279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 298/560] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:32 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:33:32.701339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:32.702456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:32.711061 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:32.711551 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:32.711987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:32.712996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:32.713462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:32.714105 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:32.863550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:32.871644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-37eaefd7-dd1c-4865-93e2-fb34d4b869ca tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.175522 Oct 04 14:33:32.872263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 263/561] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:32 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:33.690543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:33.691129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:33.697302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:33.697784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:33.698216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:33.698926 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:33.699374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:33.699795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:33.717181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:33.717704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:33.725040 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:33.725527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:33.725951 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:33.726651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:33.727097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:33.727510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:33.883019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'services' on Instance uuid 52d55b4f-410d-4527-a9d3-15f1942a46d0 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:33:33.911354 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:33.922765 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:33.925651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:33.927231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b2b7b896-7833-4fa0-a1ac-92041047ff9f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.214786 Oct 04 14:33:33.927890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 264/562] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:33 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:33:33.938504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:33.940430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:33.953051 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:33.957195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:33.958326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:33.959724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:33.960611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:33.961884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:34.106426 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b943bf1d-cd2b-4c1a-ad90-27e92dab05ba tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-volume_attachments/928ef74a-6b90-475f-84d6-be0931857070" status: 202 len: 0 microversion: 2.1 time: 0.419477 Oct 04 14:33:34.107476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 299/563] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:33:33 2022] DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-volume_attachments/928ef74a-6b90-475f-84d6-be0931857070 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:33:34.144300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:34.157937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a800492f-7fe6-4370-bf9c-8dfb7051c04d tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1315 microversion: 2.1 time: 0.222921 Oct 04 14:33:34.159447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 265/564] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:33 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:34.598800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-8b04f0c1-82b5-4b43-9680-447d6a990c0e req-044464a4-d66c-46a1-bc7e-4dfa8ae14a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "name": "network-vif-plugged", "status": "completed", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:34.616170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-8b04f0c1-82b5-4b43-9680-447d6a990c0e req-044464a4-d66c-46a1-bc7e-4dfa8ae14a89 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:34.616860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-8b04f0c1-82b5-4b43-9680-447d6a990c0e req-044464a4-d66c-46a1-bc7e-4dfa8ae14a89 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:34.617564 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-8b04f0c1-82b5-4b43-9680-447d6a990c0e req-044464a4-d66c-46a1-bc7e-4dfa8ae14a89 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:34.634865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-8b04f0c1-82b5-4b43-9680-447d6a990c0e req-044464a4-d66c-46a1-bc7e-4dfa8ae14a89 service nova] Creating event network-vif-plugged:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:33:34.640872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-8b04f0c1-82b5-4b43-9680-447d6a990c0e req-044464a4-d66c-46a1-bc7e-4dfa8ae14a89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047089 Oct 04 14:33:34.641480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 300/565] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:34.953572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:34.954830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:34.961340 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:34.961835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:34.962269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:34.962977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:34.963433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:34.963860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.106588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:35.117995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:35.119531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:35.120777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9c7c9ab6-b4d2-43c4-95dc-33a2ff082318 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.171207 Oct 04 14:33:35.121349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 266/566] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:34 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:35.192693 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:35.193380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:35.201187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:35.201779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:35.202284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.203080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:35.203756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:35.204901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.390563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:35.410728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-370c8887-39b8-4d61-821b-53d000ab07e1 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1464 microversion: 2.1 time: 0.223718 Oct 04 14:33:35.411925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 301/567] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:35 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1464 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:35.463248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:35.463751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:35.470941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:35.471443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:35.472339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.473323 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:35.473956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:35.474381 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.509823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:33:35.625636 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0b803d25-04c6-4868-870a-9bffc9bf3804 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 204 len: 0 microversion: 2.1 time: 0.165281 Oct 04 14:33:35.627149 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 267/568] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:33:35 2022] DELETE /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:33:35.638276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:35.638925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:35.646983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:35.647475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:35.647903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.648633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:35.649079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:35.649491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:35.822079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:35.832500 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-de83008e-afee-4356-a566-19fa9b7745d9 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1470 microversion: 2.1 time: 0.200035 Oct 04 14:33:35.833090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 302/569] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:35 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:36.159932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:36.160662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:36.167148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.169584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.169584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:36.170248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.170937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.171466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:36.362254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:36.368613 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-20169f1c-8c9a-4668-b68a-23caa164dd1c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:36.378533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-20169f1c-8c9a-4668-b68a-23caa164dd1c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.378533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-20169f1c-8c9a-4668-b68a-23caa164dd1c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.379021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-20169f1c-8c9a-4668-b68a-23caa164dd1c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:36.380974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:36.386145 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:36.388053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-74179b11-1c20-4b72-a20e-0338518c8080 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.236038 Oct 04 14:33:36.389154 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 268/570] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:36 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:36.418146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-20169f1c-8c9a-4668-b68a-23caa164dd1c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Going to try to stop instance {{(pid=120821) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 14:33:36.478554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:36.491051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-20169f1c-8c9a-4668-b68a-23caa164dd1c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action" status: 202 len: 0 microversion: 2.1 time: 0.126629 Oct 04 14:33:36.491660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 303/571] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:33:36 2022] POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:33:36.500829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:36.502740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:36.510860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.511310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.511756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:36.512514 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.512964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.513381 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:36.672485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:36.685823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2a2a18e5-4ff7-4dd3-9d33-fedc54ebd73d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1724 microversion: 2.1 time: 0.188952 Oct 04 14:33:36.686419 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 269/572] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:36 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:36.862581 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:36.863243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:36.870677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.871170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.871611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:36.872344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:36.873018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:36.873232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:37.061507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:37.071338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c47f0cbe-9577-4c81-9de5-e553603b0f45 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1470 microversion: 2.1 time: 0.215142 Oct 04 14:33:37.071970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 304/573] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:36 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:37.429462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:37.429462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:37.441936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:37.442830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:37.443672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:37.445058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:37.445912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:37.446703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:37.689231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:37.699210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:37.700929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:37.702221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-123d1d57-a525-4734-9e7d-237d718ea5c2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.286231 Oct 04 14:33:37.702877 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 270/574] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:37 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:37.718555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:37.720893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:37.730757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:37.732537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:37.733208 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:37.734590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:37.736290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:37.737203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:37.911616 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:37.923401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8cbaef56-7c5f-4892-a87b-3c3951ccb7c0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.212691 Oct 04 14:33:37.924457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 305/575] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:37 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:38.121434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:38.122811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:38.132474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:38.133009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:38.133449 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:38.134135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:38.134593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:38.135013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:38.592083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:38.608122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-44eac7db-5b93-4a3b-9aee-1635e86dbf2a tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1470 microversion: 2.1 time: 0.492705 Oct 04 14:33:38.609781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 271/576] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:38 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:38.736182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:38.738213 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:38.747405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:38.748269 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:38.748804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:38.749751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:38.750414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:38.752194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:38.950951 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:38.960066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:38.962673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:38.963239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d63eed7b-9691-4352-a4a7-2fb14409d4a9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1809 microversion: 2.20 time: 0.231991 Oct 04 14:33:38.963812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 306/577] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:38 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:38.973504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:38.981965 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:38.997014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:38.997583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:38.998151 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:38.999573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:38.999902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:39.000530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:39.295417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:39.335727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-87e6be0b-7801-47b0-a772-b115bf93971a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.383750 Oct 04 14:33:39.339516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 272/578] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:38 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:39.644196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:39.644854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:39.655018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:39.656364 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:39.657892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:39.659016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:39.660433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:39.661070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:39.903191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:39.918047 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2c9357fb-6ce6-4b55-a43a-13c0d8b61be6 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1470 microversion: 2.1 time: 0.278515 Oct 04 14:33:39.918987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 307/579] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:39 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:40.011680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:40.012823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:40.024511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.025356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.026319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:40.028415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.029264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.030044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:40.067988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:40.363824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:40.365711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:40.372713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.373596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.374194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:40.376081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.377592 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.380517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:40.574050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:40.603246 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:40.612156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:40.614436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:40.614836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-61ad281e-fe84-488d-baf5-1c86cf710f72 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.255218 Oct 04 14:33:40.616103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 308/580] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:40 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:40.616783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7347b17f-2843-4525-b380-34e14eca29bb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1796 microversion: 2.20 time: 0.609251 Oct 04 14:33:40.631805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-751e67ce-517d-4b5e-942b-5b7f570c8f5a req-1540743b-10a4-4bd6-8ff2-78ddfad45a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dd528f-e488-458b-8ca2-d3e60e7993e9", "name": "network-vif-deleted", "tag": "cc654320-9ffc-48fb-ad24-5ce6e03a6630"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:40.634362 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 273/581] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:33:40 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1796 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:33:40.646545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-751e67ce-517d-4b5e-942b-5b7f570c8f5a req-1540743b-10a4-4bd6-8ff2-78ddfad45a72 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.647092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-751e67ce-517d-4b5e-942b-5b7f570c8f5a req-1540743b-10a4-4bd6-8ff2-78ddfad45a72 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.647744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-751e67ce-517d-4b5e-942b-5b7f570c8f5a req-1540743b-10a4-4bd6-8ff2-78ddfad45a72 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:40.662216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-751e67ce-517d-4b5e-942b-5b7f570c8f5a req-1540743b-10a4-4bd6-8ff2-78ddfad45a72 service nova] Creating event network-vif-deleted:cc654320-9ffc-48fb-ad24-5ce6e03a6630 for instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 on hv-cinder-86026 Oct 04 14:33:40.668538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-751e67ce-517d-4b5e-942b-5b7f570c8f5a req-1540743b-10a4-4bd6-8ff2-78ddfad45a72 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050382 Oct 04 14:33:40.669397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 309/582] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:40.957196 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:40.958242 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:40.962924 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:40.969475 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.970899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.971608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:40.973219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:40.974224 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:40.974918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:41.023285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:41.024303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:41.024676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:41.025224 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lazy-loading 'fault' on Instance uuid a4dd528f-e488-458b-8ca2-d3e60e7993e9 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:33:41.116049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03bae15d7bf43bb871c1a2eed6ae09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5980ace2a72461689bfb87d48571e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:41.127781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f74c6ea7-9595-4bcf-8bb9-e27add4a5603 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 200 len: 1305 microversion: 2.1 time: 0.176515 Oct 04 14:33:41.128617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 274/583] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:40 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 1305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:41.648360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:41.649552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:41.659941 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:41.660780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:41.661348 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:41.662258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:41.662670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:41.663094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:41.883091 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:41.893831 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-54cd7e8d-6a49-402f-977e-2f20d3db27c1 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.253346 Oct 04 14:33:41.894641 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 310/584] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:41 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:42.152872 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:42.154557 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] [instance: a4dd528f-e488-458b-8ca2-d3e60e7993e9] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:42.162768 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:42.163545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:42.164121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:42.165115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:42.165684 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:42.166219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:42.184955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] HTTP exception thrown: Instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 could not be found. Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Request method failure captured: Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 HTTP/1.1 Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEQQy7D-l1p9pEYKXApRd3glc0bdPHmJnOyz3hadevVmdMsuTzC9c8fIFYkcIpIhVRPH_shzyhw03xYg01maCNNVeKZDAWzBpw-gl_L39ko0O2EvFppSyB4QDmXScg1DSixayTm9hB3LnWRn3z6vFTYJHiUZ7nIYwfW_a0BWn3W8shY Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: f5980ace2a72461689bfb87d48571e72 Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-VolumesNegativeTest-901630838 Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:33:42.187413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5980ace2a72461689bfb87d48571e72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f5980ace2a72461689bfb87d48571e72", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5980ace2a72461689bfb87d48571e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f5980ace2a72461689bfb87d48571e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-VolumesNegativeTest-901630838 Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: f5980ace2a72461689bfb87d48571e72 Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-VolumesNegativeTest-901630838 Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-VolumesNegativeTest-901630838-project Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: b03bae15d7bf43bb871c1a2eed6ae09a Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-VolumesNegativeTest-901630838-project Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 could not be found. Oct 04 14:33:42.189815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': 'a4dd528f-e488-458b-8ca2-d3e60e7993e9'} Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 could not be found. Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:33:42.190751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 could not be found. Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 could not be found. Oct 04 14:33:42.192447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:33:42.193829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] Returning 404 to user: Instance a4dd528f-e488-458b-8ca2-d3e60e7993e9 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:33:42.194343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0bd94c87-4c56-4435-bde2-8956aed42618 tempest-VolumesNegativeTest-901630838 tempest-VolumesNegativeTest-901630838-project] 10.222.0.64 "GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9" status: 404 len: 111 microversion: 2.1 time: 0.045686 Oct 04 14:33:42.195010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 275/585] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:42 2022] GET /compute/v2.1/servers/a4dd528f-e488-458b-8ca2-d3e60e7993e9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:33:42.928833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:42.930856 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:42.944712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:42.945924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:42.946670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:42.947818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:42.952648 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:42.957057 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:43.235770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:43.254949 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b114c58e-5ebb-486f-b51c-075560c3fa9d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.336400 Oct 04 14:33:43.272091 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 311/586] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:42 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:44.291300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:44.292858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:44.308235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:44.309609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:44.310549 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:44.312104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:44.312659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:44.314954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:44.552935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:44.571972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c157e66f-e5d9-4b6b-aad9-0b329a9e0630 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.284708 Oct 04 14:33:44.575302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 276/587] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:44 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:45.599696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:45.603792 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:45.618666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:45.628865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:45.629484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:45.630450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:45.631046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:45.631490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:45.815591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:45.835433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c322421b-7681-43ae-91a5-d2508d2489dc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.232808 Oct 04 14:33:45.835433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 312/588] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:45 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:46.871290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:46.873180 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:46.882588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:46.883504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:46.884284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:46.885397 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:46.886911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:46.887671 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:47.139839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:47.150348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-00fb095f-142b-460b-a2b0-782da18af22e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.283233 Oct 04 14:33:47.151502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 277/589] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:46 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:48.205127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:48.217652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:48.230003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:48.233183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:48.234345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:48.236862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:48.238585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:48.239033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:48.865662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:48.883741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0a70495b-e36f-4552-9b33-1813d407edf9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.692370 Oct 04 14:33:48.884687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 313/590] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:48 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:49.909019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:49.910316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:49.928930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:49.929474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:49.929925 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:49.935374 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:49.936050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:49.936603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.014696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:50.016822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:50.041352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.042756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.044861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.046145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.050198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.053522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.133291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0525a97d-3880-4d68-8eb4-af0086b729d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/ips" status: 200 len: 149 microversion: 2.1 time: 0.124490 Oct 04 14:33:50.133710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 314/591] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:33:50 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/ips => generated 149 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:33:50.150531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b57c8593-2a93-4e89-8c54-25e36cec3e22"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:50.158019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:50.180839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.181659 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.182115 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.182888 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.183357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.202926 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.364194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Invalid volume: volume b57c8593-2a93-4e89-8c54-25e36cec3e22 is already attached to instances: 92da7788-17c4-4129-b353-b25576213350 Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: POST /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/os-volume_attachments HTTP/1.1 Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 74 Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:33:50.373049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {"volumeAttachment": {"volumeId": "b57c8593-2a93-4e89-8c54-25e36cec3e22"}} Oct 04 14:33:50.375017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Invalid volume: volume b57c8593-2a93-4e89-8c54-25e36cec3e22 is already attached to instances: 92da7788-17c4-4129-b353-b25576213350 Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'server_id': '08e321c8-c06c-4113-a76d-21aa1a27946f', 'body': {'volumeAttachment': {'volumeId': 'b57c8593-2a93-4e89-8c54-25e36cec3e22'}}} Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b57c8593-2a93-4e89-8c54-25e36cec3e22 is already attached to instances: 92da7788-17c4-4129-b353-b25576213350 Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:50.376644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b57c8593-2a93-4e89-8c54-25e36cec3e22 is already attached to instances: 92da7788-17c4-4129-b353-b25576213350 Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:50.378394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:33:50.380020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:33:50.380020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:33:50.380020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:33:50.380020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b57c8593-2a93-4e89-8c54-25e36cec3e22 is already attached to instances: 92da7788-17c4-4129-b353-b25576213350 Oct 04 14:33:50.380020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:50.381094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 400 to user: Invalid volume: volume b57c8593-2a93-4e89-8c54-25e36cec3e22 is already attached to instances: 92da7788-17c4-4129-b353-b25576213350 {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:33:50.383994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0accacce-2ece-489f-b963-01ffa45b2080 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.241956 Oct 04 14:33:50.387359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 315/592] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:33:50 2022] POST /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f/os-volume_attachments => generated 174 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 14:33:50.397342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:50.403682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:50.423116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.428635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.429757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.430815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.435677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.436062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.484063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:50.498210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-81d8cea0-3e9e-405b-9d64-18982229e3d6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.593343 Oct 04 14:33:50.501308 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 278/593] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:49 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:50.512707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:33:50.674837 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-942ae419-0c07-470e-b969-244c7b7f39ef tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 204 len: 0 microversion: 2.1 time: 0.279403 Oct 04 14:33:50.681247 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 316/594] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:33:50 2022] DELETE /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 14:33:50.694257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:50.695101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:50.723117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.733813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.734630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:50.735966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:50.736511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:50.736961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:51.067649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:51.082800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-33c09726-0fa6-49fa-a6fc-cd71faed5233 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1681 microversion: 2.1 time: 0.398344 Oct 04 14:33:51.104766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 279/595] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:50 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1681 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:51.527567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:51.528721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:51.538134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:51.539216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:51.539868 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:51.540875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:51.541586 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:51.542248 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:51.748892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:51.762239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1338cf46-b845-480e-81e6-c4c10a496db9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.239516 Oct 04 14:33:51.777042 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 317/596] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:51 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:52.124587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:52.126812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:52.137443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:52.138569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:52.139405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:52.144713 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:52.145714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:52.146430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:52.502295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:52.526917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fd5cee09-9232-4c28-b0c5-059a6e848563 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1681 microversion: 2.1 time: 0.414137 Oct 04 14:33:52.528493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 280/597] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:52 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:52.787804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:52.789216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:52.795763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:52.796258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:52.797080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:52.797965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:52.798705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:52.799142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:53.036701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:53.056711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-69970985-19cc-46c0-9d5a-4d0c6cb73afa tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1678 microversion: 2.1 time: 0.271761 Oct 04 14:33:53.058263 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 318/598] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:52 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:53.553135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:53.554532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:53.563472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:53.564220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:53.565528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:53.566553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:53.567238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:53.568660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-769699169", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "networks": [{"uuid": "43cb4147-4d5f-4bad-9d73-94e85a7a487f"}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:53.569424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:53.652955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] validate_networks() for [('43cb4147-4d5f-4bad-9d73-94e85a7a487f', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:33:53.827501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:53.839847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-084acd1a-c336-4a3f-910f-fe63e8596226 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1681 microversion: 2.1 time: 0.292593 Oct 04 14:33:53.841051 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 281/599] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:53 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:54.084291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:54.085289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:54.095461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:54.099701 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:54.101322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:54.103382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:54.108754 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:54.109229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:54.350569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:33:54.351650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:33:54.352570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:33:54.353276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:33:54.353961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:33:54.371511 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:54.372285 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:54.373243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:54.375207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:54.376266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:54.377060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:54.404257 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Getting quotas for project 742e9ad0995f4f96bcc1f75f5689a590. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:33:54.427738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Getting quotas for user 6ec52681fc41477e92786ad61aa96a76 and project 742e9ad0995f4f96bcc1f75f5689a590. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:33:54.461504 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:33:54.464872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:33:54.598145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2be757f6-d443-4f12-bf41-0df8b2800db0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034978 Oct 04 14:33:54.605324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 319/600] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:33:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:33:54.614017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f477d62c-cccb-4961-bfb3-dac90592aeb2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:54.614633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f477d62c-cccb-4961-bfb3-dac90592aeb2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:54.684813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:54.698336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d003a55a-160b-468e-847b-34d2370e2d7b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1655 microversion: 2.1 time: 0.618400 Oct 04 14:33:54.699653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 282/601] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:54 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1655 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:54.722248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d8301408-ec12-4cf5-96fc-65b35ba68b86 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:54.743410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d8301408-ec12-4cf5-96fc-65b35ba68b86 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:54.744210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d8301408-ec12-4cf5-96fc-65b35ba68b86 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:54.748121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d8301408-ec12-4cf5-96fc-65b35ba68b86 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:54.765679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f477d62c-cccb-4961-bfb3-dac90592aeb2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:54.817126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f477d62c-cccb-4961-bfb3-dac90592aeb2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1218 microversion: 2.1 time: 0.206293 Oct 04 14:33:54.818193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 320/602] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:54 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:54.836680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-523c4586-645c-451c-b8c7-509a26b5db51 req-94d0d5f5-0a0e-49b4-88ac-29e5dc135708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e321c8-c06c-4113-a76d-21aa1a27946f", "name": "network-vif-deleted", "tag": "ae758bb2-370d-4f68-a541-62eb3b42c185"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:54.874324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-523c4586-645c-451c-b8c7-509a26b5db51 req-94d0d5f5-0a0e-49b4-88ac-29e5dc135708 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:54.882507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-523c4586-645c-451c-b8c7-509a26b5db51 req-94d0d5f5-0a0e-49b4-88ac-29e5dc135708 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:54.883384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-523c4586-645c-451c-b8c7-509a26b5db51 req-94d0d5f5-0a0e-49b4-88ac-29e5dc135708 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:54.894543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d8301408-ec12-4cf5-96fc-65b35ba68b86 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Going to try to start instance {{(pid=120820) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 14:33:54.924282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-523c4586-645c-451c-b8c7-509a26b5db51 req-94d0d5f5-0a0e-49b4-88ac-29e5dc135708 service nova] Creating event network-vif-deleted:ae758bb2-370d-4f68-a541-62eb3b42c185 for instance 08e321c8-c06c-4113-a76d-21aa1a27946f on hv-cinder-86026 Oct 04 14:33:54.950759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-523c4586-645c-451c-b8c7-509a26b5db51 req-94d0d5f5-0a0e-49b4-88ac-29e5dc135708 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119624 Oct 04 14:33:54.951749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 321/603] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:54.982679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:54.996711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:55.039862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.041669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.045030 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:55.045894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.051716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.055199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:55.085706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:55.089724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d8301408-ec12-4cf5-96fc-65b35ba68b86 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action" status: 202 len: 0 microversion: 2.1 time: 0.371499 Oct 04 14:33:55.095241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 283/604] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:33:54 2022] POST /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:33:55.131746 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:55.134125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:55.157473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.162676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.164675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:55.166744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.170339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.171123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:55.190184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.190950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.191554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:55.192198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'fault' on Instance uuid 08e321c8-c06c-4113-a76d-21aa1a27946f {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:33:55.296274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:55.306855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-95be0e20-20ec-4e90-b8a1-2522ba9f8df6 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 200 len: 1332 microversion: 2.1 time: 0.351787 Oct 04 14:33:55.325971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 322/605] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:54 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 1332 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:55.645261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:55.657889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2dfffebb-e0b8-40cf-8875-f7d0d242cd03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1664 microversion: 2.1 time: 0.557564 Oct 04 14:33:55.677226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 284/606] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:55 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1664 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:55.854366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:55.868456 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:55.907300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.907948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.908409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:55.913027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:55.913750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:55.915234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.029804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:56.052215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9a10e6a6-8a47-4162-b89e-1678f089fc08 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1222 microversion: 2.1 time: 0.209998 Oct 04 14:33:56.052852 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 323/607] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:55 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:56.100543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df592fe3-713b-488d-ab81-bda5afdb198f"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:33:56.111441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:56.137305 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:56.140650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:56.142641 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.145087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:56.146840 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:56.150527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.337887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:56.339478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:56.358678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:56.360956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:56.376600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.380233 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:56.381835 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:56.382524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.439016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f HTTP/1.1 Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:33:56.456206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:33:56.457874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '08e321c8-c06c-4113-a76d-21aa1a27946f'} Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:33:56.458803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:33:56.461019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:33:56.463056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:33:56.463056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aa0aa7d0-9ca2-42fd-8d1c-c25c22e0906b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 404 len: 111 microversion: 2.1 time: 0.131457 Oct 04 14:33:56.463056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 324/608] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:56 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:33:56.467391 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7c491571-c57f-4b29-b489-d543423445a8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '.version_select at 0x7f5718838d30>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:56.561106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7c491571-c57f-4b29-b489-d543423445a8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320786995" status: 202 len: 0 microversion: 2.1 time: 0.097699 Oct 04 14:33:56.565845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 325/609] 10.222.0.64 () {58 vars in 1221 bytes} [Tue Oct 4 14:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320786995 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:33:56.689822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:56.690906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:56.712905 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:56.717008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:56.720628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.722843 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:56.725167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:56.728618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:56.951142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-870229df-f00f-4e34-a38f-d3173f007dcb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.855120 Oct 04 14:33:56.954806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 285/610] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:33:56 2022] POST /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:57.122690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:57.124087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:57.181934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:57.182452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:57.182903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:57.189803 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:57.190357 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:57.192884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:57.284050 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:57.308338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-df467903-52b3-4b7e-afa7-c54b45e9e79a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1664 microversion: 2.1 time: 0.623648 Oct 04 14:33:57.314451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 326/611] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:56 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1664 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:57.395117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:57.424420 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-70a9f903-5c2c-4c99-9a01-74cbe28179dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1270 microversion: 2.1 time: 0.312615 Oct 04 14:33:57.430313 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 286/612] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:57 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1270 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:58.337371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:58.339038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:58.354215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:58.356529 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:58.359416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:58.362012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:58.364300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:58.368067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:58.457099 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:58.457462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:58.483956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:58.485012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:58.485468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:58.486202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:58.486728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:58.487163 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:58.673044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:58.685195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c23d3983-5efc-4095-ab5d-dd54e34aa9f9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1288 microversion: 2.1 time: 0.234445 Oct 04 14:33:58.685729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 287/613] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:58 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1288 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:33:58.700267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:58.703981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:58.719534 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:58.720200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:58.720677 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:58.723615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:58.724454 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:58.730378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:58.752769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:33:58.782673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b2ff677e-fbb1-433e-a2ca-b374ec990938 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1668 microversion: 2.1 time: 0.450979 Oct 04 14:33:58.790837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:33:58.813361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 327/614] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:58 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1668 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:33:58.947528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'services' on Instance uuid 92da7788-17c4-4129-b353-b25576213350 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:33:59.094171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-faa65f98-d5d8-4653-9e9f-4d0fdf26b4f7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments/b57c8593-2a93-4e89-8c54-25e36cec3e22" status: 202 len: 0 microversion: 2.1 time: 0.403617 Oct 04 14:33:59.095104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 288/615] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:33:58 2022] DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments/b57c8593-2a93-4e89-8c54-25e36cec3e22 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:33:59.104038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:59.106712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:59.125827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:59.126432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:59.129433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:59.132844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:59.135357 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:59.135989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:59.202267 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1c434fc1-8288-4570-bc93-8008c6c9a8b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102447 Oct 04 14:33:59.209453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 328/616] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:33:59 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:33:59.714503 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:33:59.715922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:33:59.736657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:59.737367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:59.738708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:33:59.739618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:33:59.742803 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:33:59.744115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:00.216523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:00.220139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:00.226848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:00.227600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:00.228224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:00.229133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:00.229751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:00.230369 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:00.335620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-55faebe1-ad32-4408-a072-b2bbdc1f18e1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122930 Oct 04 14:34:00.337421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 329/617] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:00 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:00.408792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:00.420388 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6b9a2b3d-2ab6-4da2-b4db-8efb1d128778 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.714480 Oct 04 14:34:00.421005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 289/618] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:33:59 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:01.271159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-4f307c3a-11ca-4852-ab97-569cc222cd80 req-e0aef801-1f8a-4697-9bf2-7d7901d3b758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7e1d84-2636-4738-a919-b595b40b8ca0", "tag": "94339d45-a083-4b8d-984f-7ad2590b96fd"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:01.292608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:01.319601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-4f307c3a-11ca-4852-ab97-569cc222cd80 req-e0aef801-1f8a-4697-9bf2-7d7901d3b758 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:01.321810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-4f307c3a-11ca-4852-ab97-569cc222cd80 req-e0aef801-1f8a-4697-9bf2-7d7901d3b758 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:01.322491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-4f307c3a-11ca-4852-ab97-569cc222cd80 req-e0aef801-1f8a-4697-9bf2-7d7901d3b758 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:01.351149 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-4f307c3a-11ca-4852-ab97-569cc222cd80 req-e0aef801-1f8a-4697-9bf2-7d7901d3b758 service nova] Creating event network-changed:94339d45-a083-4b8d-984f-7ad2590b96fd for instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 on hv-cinder-86026 Oct 04 14:34:01.352262 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:01.354718 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:01.370113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-4f307c3a-11ca-4852-ab97-569cc222cd80 req-e0aef801-1f8a-4697-9bf2-7d7901d3b758 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092723 Oct 04 14:34:01.371302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:01.371870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:01.372026 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 330/619] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:01.381688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:01.382547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:01.383199 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:01.383810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:01.437125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0bfebd05-fa9e-4b8c-ab86-21244b18617b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090458 Oct 04 14:34:01.438452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 290/620] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:01 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:01.462838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:01.463969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:01.481816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:01.482425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:01.482913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:01.483759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:01.484227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:01.485440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:01.673542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:01.682892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f756cfb9-3084-4bf2-b907-3a52f556da8e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.229715 Oct 04 14:34:01.691800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 331/621] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:01 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:02.454063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:02.456570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:02.464644 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:02.465500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:02.466005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:02.466957 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:02.467482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:02.468086 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:02.501839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9b8239d2-7ec1-4186-8473-ee6a5474ce16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052307 Oct 04 14:34:02.502690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 291/622] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:02 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:02.707782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:02.708617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:02.717441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:02.718320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:02.719104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:02.720102 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:02.721056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:02.721746 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:02.908077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:02.917165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0443a188-e316-4213-b7dc-01b94e898e76 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.214112 Oct 04 14:34:02.918301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 332/623] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:02 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:03.515519 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:03.517831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:03.530217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:03.531464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:03.532260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:03.533860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:03.534477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:03.534912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:03.569755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-229df48c-5e64-477f-8a14-816f5f714d19 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058128 Oct 04 14:34:03.570936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 292/624] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:03 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:03.954448 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:03.955345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:03.967302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:03.968474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:03.969773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:03.971143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:03.971836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:03.972505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:04.151743 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:04.160887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-374bc5ea-5d10-48ee-bbf0-0f1d8c837138 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.214069 Oct 04 14:34:04.161790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 333/625] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:03 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:04.583991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:04.589131 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:04.600478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:04.601447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:04.602939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:04.604774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:04.605300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:04.605919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:04.650076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2de9eadf-311a-40f8-8e3f-05f61650fdd3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070171 Oct 04 14:34:04.651020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 293/626] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:04 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:05.126721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:05.130468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:05.133580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:05.134290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=8 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:05.141884 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.142382 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.143016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.143912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.144593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.145027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.188095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:05.188842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:05.199135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.200252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.201057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.202621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.203512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.204601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.209592 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'flavor' on Instance uuid 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:05.486492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ec7e520c-8a25-4c23-bf90-2e9f245e64ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/action" status: 200 len: 32 microversion: 2.1 time: 0.367656 Oct 04 14:34:05.495788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 334/627] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:34:05 2022] POST /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:34:05.510787 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:05.515195 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:05.521225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:05.530208 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.530752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.531975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.533256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.533772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.536069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.551402 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-154bc385-9731-4573-92dd-b0cc179c3660 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.368493 Oct 04 14:34:05.552010 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 294/628] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:05 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:05.673483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:05.677577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:05.693475 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.694799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.696829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.698401 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.699486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.710732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.766146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-00146ce8-0396-474c-9756-37a37f2c8029 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102825 Oct 04 14:34:05.767652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 295/629] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:05 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 14:34:05.807196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:05.823227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1633ac3d-25d0-454a-977f-8434076c8ceb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.323552 Oct 04 14:34:05.824778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 335/630] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:05 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:05.894411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:05.895281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:05.909205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.910019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.910642 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.911387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:05.911887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:05.912349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:05.942736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:34:06.106344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f3e71f88-2912-4f70-94b8-da3f61b0ab2b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 204 len: 0 microversion: 2.1 time: 0.216625 Oct 04 14:34:06.107446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 296/631] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:34:05 2022] DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:34:06.117071 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:06.117961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:06.128160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.129442 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.130037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.130957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.131619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.132297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.342782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:06.354363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ff435c3c-d237-4c7b-b2cb-bc9855a853af tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1680 microversion: 2.1 time: 0.242110 Oct 04 14:34:06.354960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 336/632] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:06 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:06.580839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:06.581565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:06.592626 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.593128 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.594298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.594428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.594808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.595237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.771125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-ed7106c1-7880-47b8-84e7-c6cf9a1f72f4 req-f26de232-bcf6-4da3-9ebb-bce3df8e3b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e1d84-2636-4738-a919-b595b40b8ca0", "name": "network-vif-plugged", "status": "completed", "tag": "94339d45-a083-4b8d-984f-7ad2590b96fd"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:06.792255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-ed7106c1-7880-47b8-84e7-c6cf9a1f72f4 req-f26de232-bcf6-4da3-9ebb-bce3df8e3b92 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.792255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-ed7106c1-7880-47b8-84e7-c6cf9a1f72f4 req-f26de232-bcf6-4da3-9ebb-bce3df8e3b92 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.792255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-ed7106c1-7880-47b8-84e7-c6cf9a1f72f4 req-f26de232-bcf6-4da3-9ebb-bce3df8e3b92 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.817278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-ed7106c1-7880-47b8-84e7-c6cf9a1f72f4 req-f26de232-bcf6-4da3-9ebb-bce3df8e3b92 service nova] Creating event network-vif-plugged:94339d45-a083-4b8d-984f-7ad2590b96fd for instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 on hv-cinder-86026 Oct 04 14:34:06.823821 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-ed7106c1-7880-47b8-84e7-c6cf9a1f72f4 req-f26de232-bcf6-4da3-9ebb-bce3df8e3b92 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058506 Oct 04 14:34:06.824766 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 337/633] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:06.848108 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:06.848861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:06.862877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.863386 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.863836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.864599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:06.865066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:06.865543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:06.884544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:06.911747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3d184d90-bedb-449e-8d36-7c8209137ba9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.336358 Oct 04 14:34:06.928348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 297/634] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:06 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:07.053621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:07.065844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e4baecce-8068-4fa8-a6d6-588792a6f405 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.222168 Oct 04 14:34:07.066440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 338/635] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:06 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:07.386442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:07.387072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:07.394304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:07.394809 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:07.395250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:07.395974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:07.396538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:07.396912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:07.556982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:07.566107 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c3b29ca3-cd94-4fff-b286-62015e95a198 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1680 microversion: 2.1 time: 0.183691 Oct 04 14:34:07.566697 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 298/636] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:07 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:07.942245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:07.943112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:07.959623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:07.960118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:07.960606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:07.961326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:07.961779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:07.962202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:07.987354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:08.091919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:08.092583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:08.102371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:08.103163 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:08.104213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:08.105265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:08.105738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:08.106171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:08.160569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:08.169611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8a0275d3-f600-4ebb-918a-5f20d71aa694 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.231898 Oct 04 14:34:08.169918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 339/637] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:07 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:08.214222 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f4382f86-a0e6-43ee-a3eb-6e05b89502b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Action: 'create', calling method: .version_select at 0x7f5718a2a0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1397666128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq95KO7qrJ121qtl24Rp4FAxyNvqx4K5Qy2u1R/HMryUdaxuScAouA1eWbzUmjQln186gg2H1nUM+L1OYCZAbNbg8MhuBt7RszEgpRK5ySoQhb/vCMkYXFU2E0qyCWc/w=="}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:08.235730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-f4382f86-a0e6-43ee-a3eb-6e05b89502b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Getting quotas for project 9cf9a725cf7e42ea939bee84113b12ee. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:08.240237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-f4382f86-a0e6-43ee-a3eb-6e05b89502b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Getting quotas for user cab40292db0d4a74b1fd59c3539e81e3 and project 9cf9a725cf7e42ea939bee84113b12ee. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:08.273040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f4382f86-a0e6-43ee-a3eb-6e05b89502b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062857 Oct 04 14:34:08.273660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 340/638] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:34:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:08.391143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-628404382", "imageRef": "cb096686-1aba-46fc-b3ac-0ca19647e7ca", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1397666128", "networks": [{"uuid": "fa33c312-594b-49b2-bd86-df2f885aca0c"}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:08.403441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:08.427981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6faa72f2-fbeb-493b-a0c2-10d62e3fc95a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.341034 Oct 04 14:34:08.442896 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 299/639] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:08 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:08.485109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] validate_networks() for [('fa33c312-594b-49b2-bd86-df2f885aca0c', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:34:08.590261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:08.590875 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:08.597761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:08.598247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:08.598863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:08.599566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:08.600208 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:08.600810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:08.800834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:08.811020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-880d75c9-b33d-4712-a712-237e5e120396 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1680 microversion: 2.1 time: 0.224812 Oct 04 14:34:08.811863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 300/640] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:08 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:08.913131 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:34:08.913558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:34:08.914058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:34:08.914467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:34:08.914892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:34:08.924857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:08.925330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:08.925765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:08.926490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:08.926937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:08.927348 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:08.945596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Getting quotas for project 9cf9a725cf7e42ea939bee84113b12ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:08.950770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Getting quotas for user cab40292db0d4a74b1fd59c3539e81e3 and project 9cf9a725cf7e42ea939bee84113b12ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:08.963124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:34:08.965410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb096686-1aba-46fc-b3ac-0ca19647e7ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:34:09.014488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-53172b90-fd74-4021-992b-12e9c88fc9f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628243 Oct 04 14:34:09.016395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 341/641] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:34:09.028028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2c2238e7-1a33-405f-9269-ec6bc702da81 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:09.029340 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2c2238e7-1a33-405f-9269-ec6bc702da81 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:09.113226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2c2238e7-1a33-405f-9269-ec6bc702da81 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:09.122028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2c2238e7-1a33-405f-9269-ec6bc702da81 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1258 microversion: 2.1 time: 0.098007 Oct 04 14:34:09.122627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 301/642] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:09 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:09.195465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:09.196405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:09.203485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.208933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.209572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.211052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.211856 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.212813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.235343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-d6358267-d910-45f7-92f7-114ed6cf50ca req-409a485c-e325-4546-8768-0419669a4a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92da7788-17c4-4129-b353-b25576213350", "name": "network-vif-deleted", "tag": "3a45f381-06ca-4183-af22-7b3ce0bb06a4"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:09.272353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d6358267-d910-45f7-92f7-114ed6cf50ca req-409a485c-e325-4546-8768-0419669a4a09 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.273132 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d6358267-d910-45f7-92f7-114ed6cf50ca req-409a485c-e325-4546-8768-0419669a4a09 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.273798 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d6358267-d910-45f7-92f7-114ed6cf50ca req-409a485c-e325-4546-8768-0419669a4a09 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.291707 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-d6358267-d910-45f7-92f7-114ed6cf50ca req-409a485c-e325-4546-8768-0419669a4a09 service nova] Creating event network-vif-deleted:3a45f381-06ca-4183-af22-7b3ce0bb06a4 for instance 92da7788-17c4-4129-b353-b25576213350 on hv-cinder-86026 Oct 04 14:34:09.313201 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-d6358267-d910-45f7-92f7-114ed6cf50ca req-409a485c-e325-4546-8768-0419669a4a09 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084151 Oct 04 14:34:09.314397 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 302/643] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:09.454954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:09.461326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:09.462014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:09.473843 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1ad3f1d9-4bd7-4bce-9687-783e883cb6d9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1318 microversion: 2.1 time: 0.282394 Oct 04 14:34:09.487943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.488472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.488911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.490396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.491260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.491907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.492755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 342/644] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:09 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:09.647227 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:09.657160 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7d757617-b4ef-4a90-8073-c717a26f0ce0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.204654 Oct 04 14:34:09.657758 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 303/645] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:09 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:09.836491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:09.837090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:09.843213 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.844469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.845124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.845870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.846324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.846746 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.882810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:09.883306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:09.883735 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:09.884185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'fault' on Instance uuid 92da7788-17c4-4129-b353-b25576213350 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:09.926817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:09.934670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-04933e5e-ff2c-431e-a16e-b3e946ef5a0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1331 microversion: 2.1 time: 0.102124 Oct 04 14:34:09.935288 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 343/646] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:09 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:10.147055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:10.147799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:10.154705 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.155195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.155627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.156845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.157581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.158014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.162703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:10.249472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:10.260411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-35b1f69a-4f4c-4b4f-b475-1233b71506ed tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1262 microversion: 2.1 time: 0.118322 Oct 04 14:34:10.261009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 304/647] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:10 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1262 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:10.501385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:10.502279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:10.509042 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.509610 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.510160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.511048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.511568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.512077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.664005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:10.673479 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f4e0cf90-8891-4ed0-8673-7e9f5b581111 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1507 microversion: 2.1 time: 0.178157 Oct 04 14:34:10.674075 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 344/648] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:10 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:10.681319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:10.681931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:10.688326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.688832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.689266 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.689977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.690433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.690865 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.842763 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:10.853511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-abbc974d-b8c8-470d-a33a-25d3f76ae558 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.176090 Oct 04 14:34:10.854105 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 305/649] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:10 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:10.964154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:10.964885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:10.972795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.973385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.973826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:10.974540 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:10.975085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:10.975615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:11.012276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:11.012799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:11.013233 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:11.013684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'fault' on Instance uuid 92da7788-17c4-4129-b353-b25576213350 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:11.062900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:11.073961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7db052b1-fbc6-4579-99c2-6b798646ac7e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 200 len: 1331 microversion: 2.1 time: 0.117852 Oct 04 14:34:11.075409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 345/650] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:10 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:11.287505 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:11.288122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:11.290565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:11.296176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:11.297355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:11.297790 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:11.298486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:11.298938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:11.299356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:11.365956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:11.373958 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-979072a2-61cb-40f7-b1be-167ed84c1b14 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1310 microversion: 2.1 time: 0.090577 Oct 04 14:34:11.374580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 306/651] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:11 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:11.877408 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:11.878016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:11.884728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:11.885398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:11.886131 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:11.886987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:11.887502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:11.888132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:12.074305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:12.083937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1a110cb4-61ab-4d01-b190-3ac77e2d17bf tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.210577 Oct 04 14:34:12.084569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 346/652] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:11 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:12.100616 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:12.101497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:12.112071 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:12.112599 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:12.113039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:12.113745 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:12.114195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:12.114612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:12.129281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 HTTP/1.1 Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:34:12.131064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:34:12.132708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '92da7788-17c4-4129-b353-b25576213350'} Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:34:12.133583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:34:12.135021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:12.136663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:34:12.136663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cb1e5017-8c7b-4b69-b8c0-ce502e1616d8 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 404 len: 111 microversion: 2.1 time: 0.036434 Oct 04 14:34:12.136663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 307/653] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:12 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:34:12.141841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-43310dea-1eef-4210-91ad-cdec32001369 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '.version_select at 0x7f57187c13a0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:12.163334 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-43310dea-1eef-4210-91ad-cdec32001369 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-232781648" status: 202 len: 0 microversion: 2.1 time: 0.025669 Oct 04 14:34:12.163949 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 347/654] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Oct 4 14:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-232781648 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:34:12.398429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:12.399730 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:12.407866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:12.408692 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:12.409392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:12.410309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:12.412274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:12.413030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:12.537586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:12.554676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3fb9420d-8b0f-4266-9169-4735a07964c6 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1316 microversion: 2.1 time: 0.161114 Oct 04 14:34:12.557950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 308/655] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:12 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:13.111223 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:13.111978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:13.121749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:13.122243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:13.123852 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:13.125332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:13.126212 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:13.126762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:13.361382 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:13.375632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ee833bd7-6cb2-4424-8916-c89e1d12419c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.269749 Oct 04 14:34:13.376276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 348/656] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:13 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:13.587682 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:13.589330 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:13.609092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:13.610489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:13.612342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:13.613560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:13.614237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:13.614937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:13.888893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-72f52d82-765f-4c97-bc53-1971ef310a16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: .version_select at 0x7f5718944b80>, body: {"keypair": {"name": "tempest-keypair-566406842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw43f2WH5YJ0519/L/q48t6J7wXJzxM+IRhWegEMPBHDK6ejWxMsxEW8etoxs97CoxgpUl5yoEjPoqIM1mpX0e04T6RO7pGf9QbnHnJqnRQ1lJHt1zf9lc26RppjuQhmQ=="}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:13.899815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:13.910061 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bb5dc6dc-a198-48ca-a82e-c1c3a4c1b9d4 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.328247 Oct 04 14:34:13.910917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 309/657] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:13 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:13.916421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-72f52d82-765f-4c97-bc53-1971ef310a16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:13.920705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-72f52d82-765f-4c97-bc53-1971ef310a16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:13.949768 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-72f52d82-765f-4c97-bc53-1971ef310a16 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069551 Oct 04 14:34:13.950386 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 349/658] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:34:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:14.411244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:14.411751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:14.419777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:14.420851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:14.422412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:14.424586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:14.425752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:14.426358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:14.641299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:14.660819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-97cfe3c4-45c7-49be-8159-488cbcb08a81 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.256993 Oct 04 14:34:14.661951 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 310/659] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:14 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:14.935981 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:14.937606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:14.944286 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:14.945013 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:14.945412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:14.946413 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:14.946563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:14.946956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:15.201132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:15.221475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-642e1320-3b26-4fd5-b9c5-0d261cfc8b64 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.290303 Oct 04 14:34:15.222017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 350/660] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:14 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:15.685258 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:15.686774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:15.695060 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:15.695898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:15.710545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:15.710545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:15.710545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:15.710545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:15.717854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1858403887", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e89e862-e669-4987-af44-eb18dbc3b78d"}], "security_groups": [{"name": "tempest-securitygroup--600809163"}], "key_name": "tempest-keypair-566406842", "user_data": "}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:15.868260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:15.878024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ef53d511-5698-47f3-837d-7760be28eabe tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.196808 Oct 04 14:34:15.878615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 311/661] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:15 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:16.247087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:16.247783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:16.255081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:16.255574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:16.256009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:16.256850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:16.257219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:16.257715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:16.412124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:16.420904 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c521eb2f-ef02-4d28-9631-efea11f9787a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.178135 Oct 04 14:34:16.422310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 312/662] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:16 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:16.902477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:16.903263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:16.910634 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:16.911234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:16.911742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:16.912717 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:16.913175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:16.913600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:17.076661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:17.091885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cab9dca2-3ea4-4930-bad2-e74a2281c6dd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.193595 Oct 04 14:34:17.093863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 313/663] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:16 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:17.444960 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:17.445569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:17.452300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:17.453754 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:17.454200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:17.454954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:17.455983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:17.455983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:17.620293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:17.631339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8bcd1275-6c53-4c92-a0b3-590f9fb67fe7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.190319 Oct 04 14:34:17.631937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 314/664] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:17 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:18.117454 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:18.118428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:18.126578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:18.127080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:18.127793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:18.128555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:18.129020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:18.129447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:18.276524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:18.290509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2f787c15-ef19-491f-8b1c-c356b1cf2dc7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.176950 Oct 04 14:34:18.291298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 315/665] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:18 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:18.655656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:18.656706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:18.664182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:18.664948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:18.665388 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:18.666102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:18.666550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:18.666965 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:18.832781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:18.846264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c57f12e8-4dc4-4a48-9e09-e9bbba2dae73 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.194759 Oct 04 14:34:18.852165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 316/666] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:18 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:18.934811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:19.317643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:19.319078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:19.324182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:19.332711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:19.333998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:19.334934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:19.336104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:19.336747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:19.337642 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:19.510659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:19.522365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-465780ec-59dd-49af-91c9-180fd79c16be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.211032 Oct 04 14:34:19.523336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 317/667] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:19 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:19.871251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:19.871998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:19.881108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:19.881543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:19.882053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:19.882887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:19.883423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:19.884037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:20.112790 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:20.120907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dd3ef5ff-cbb1-4c11-9af8-6696b0fcd061 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.254189 Oct 04 14:34:20.121568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 318/668] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:19 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:20.550897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:20.551662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:20.563110 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:20.563859 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:20.564669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:20.565905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:20.566884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:20.567675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:20.756301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:20.766491 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-78151705-8363-44a1-a690-f81490dfece8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.222932 Oct 04 14:34:20.767089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 319/669] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:20 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:21.143496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:21.144116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:21.150747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:21.151240 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:21.151675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:21.152426 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:21.152884 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:21.153309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:21.316839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:21.325531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c8fb5f2f-9829-4bf0-bc8f-0f49b1e863c3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.186166 Oct 04 14:34:21.326081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 320/670] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:21 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:21.791197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:21.792075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:21.799044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:21.799472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:21.799912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:21.800658 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:21.801117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:21.801546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:21.821508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:21.972476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:21.992973 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a61c5ce6-8271-48e6-81c7-9f9b3375b79a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.205322 Oct 04 14:34:21.993945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 321/671] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:21 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:22.351325 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:22.352008 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:22.361313 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:22.361954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:22.362399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:22.363483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:22.363981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:22.364467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:22.507410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:22.517047 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5b8d8621-377e-4a2e-9f22-9e22b90484da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.170302 Oct 04 14:34:22.517689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 322/672] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:22 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:22.644065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] validate_networks() for [('3e89e862-e669-4987-af44-eb18dbc3b78d', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:34:23.028926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:23.029655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:23.036848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:23.037335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:23.037802 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:23.038507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:23.038960 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:23.039382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:23.049449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:34:23.049868 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:34:23.050431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:34:23.050840 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:34:23.051249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:34:23.060701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:23.061214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:23.061682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:23.063301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:23.063754 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:23.064176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:23.084907 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:23.091430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:23.106271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:34:23.109163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:34:23.140252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:23.190056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-55c804a0-f116-40db-b0dc-cf8ac0353cbb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.477769 Oct 04 14:34:23.191671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 351/673] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:34:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 7480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:34:23.199414 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:23.208560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-40fe1d38-5692-45ee-9215-c69d62acf3c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.183422 Oct 04 14:34:23.209352 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 323/674] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:23 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:23.213571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-515e9715-8d1d-437d-a79e-13b24689162a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:23.214278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-515e9715-8d1d-437d-a79e-13b24689162a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:23.277875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-515e9715-8d1d-437d-a79e-13b24689162a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:23.290044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-515e9715-8d1d-437d-a79e-13b24689162a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1241 microversion: 2.1 time: 0.077263 Oct 04 14:34:23.290044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 352/675] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:23 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:23.544264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:23.546500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:23.564801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:23.566330 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:23.567925 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:23.570267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:23.571564 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:23.572733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:23.827806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:23.836867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-25efe7e4-37e7-4ad9-a42b-0df26a3aa2f5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.297280 Oct 04 14:34:23.837679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 324/676] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:23 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:24.234393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:24.235015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:24.241703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.242123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.242550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.243499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.244250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.244712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.276796 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-673d66c1-f96a-496e-8e3a-45516cecf260 req-8c3d5180-0782-4132-864c-8c10eaa01e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:24.294942 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-673d66c1-f96a-496e-8e3a-45516cecf260 req-8c3d5180-0782-4132-864c-8c10eaa01e43 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.295733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-673d66c1-f96a-496e-8e3a-45516cecf260 req-8c3d5180-0782-4132-864c-8c10eaa01e43 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.296507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-673d66c1-f96a-496e-8e3a-45516cecf260 req-8c3d5180-0782-4132-864c-8c10eaa01e43 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.315808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-673d66c1-f96a-496e-8e3a-45516cecf260 req-8c3d5180-0782-4132-864c-8c10eaa01e43 service nova] Creating event network-changed:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:34:24.323357 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-673d66c1-f96a-496e-8e3a-45516cecf260 req-8c3d5180-0782-4132-864c-8c10eaa01e43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059279 Oct 04 14:34:24.324863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 325/677] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:24.333439 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:24.334056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:24.340299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.340827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.341265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.341973 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.342428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.343420 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.374974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5208ff04-fe81-4f55-87de-49492cf4920c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments/20eaef44-546c-49f1-b9f7-3a87080cfcb3" status: 200 len: 194 microversion: 2.20 time: 0.045771 Oct 04 14:34:24.375591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 326/678] 10.222.0.64 () {60 vars in 1454 bytes} [Tue Oct 4 14:34:24 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments/20eaef44-546c-49f1-b9f7-3a87080cfcb3 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:34:24.380289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:24.380944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:24.387849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.387849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.388278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.389353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.389353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.390292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.461310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:24.469918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:24.470931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d759b00a-4a9b-4a58-9767-42e19a81eb4e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.240441 Oct 04 14:34:24.471516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 353/679] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:24 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:24.479073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:24.479829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:24.484907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-63a429fa-5d84-4809-ab46-e2293894d5fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1293 microversion: 2.1 time: 0.107222 Oct 04 14:34:24.492455 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 327/680] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:24 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:24.492670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.492670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.492670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.492670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.492994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.492994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.603332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lazy-loading 'services' on Instance uuid 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:24.685155 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f25cdafc-c536-459c-a86f-1c4b8163a303 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments/20eaef44-546c-49f1-b9f7-3a87080cfcb3" status: 202 len: 0 microversion: 2.20 time: 0.212265 Oct 04 14:34:24.685956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 354/681] 10.222.0.64 () {60 vars in 1457 bytes} [Tue Oct 4 14:34:24 2022] DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments/20eaef44-546c-49f1-b9f7-3a87080cfcb3 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:34:24.695651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:24.698087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:24.706099 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.706660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.707197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.708000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.708620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.709137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.744448 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d57356ce-5561-4b22-a644-0f89163d7657 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052745 Oct 04 14:34:24.744950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 328/682] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Oct 4 14:34:24 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:34:24.863041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:24.863750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:24.870500 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.870992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.871430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:24.872143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:24.872620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:24.873054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.031978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:25.040296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9ca4bf47-8fe0-4ab4-9c9d-eb9d2c13174c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.183045 Oct 04 14:34:25.040909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 355/683] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:24 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:25.496946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:25.497589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:25.504568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:25.505069 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:25.505523 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.506289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:25.506760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:25.507195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.510867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:25.511545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:25.517898 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:25.518379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:25.518808 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.519525 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:25.519975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:25.520424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.600510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:25.608440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-35f86008-6f6c-4a2d-a524-3291deef35cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1293 microversion: 2.1 time: 0.101749 Oct 04 14:34:25.610346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 356/684] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:25 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:25.670045 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:25.680011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-801bf4b9-7786-4306-8b3e-2e18859eb97a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.186806 Oct 04 14:34:25.680720 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 329/685] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:25 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:25.758826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:25.761142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:25.773799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:25.774301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:25.774740 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.775552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:25.775919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:25.776371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:25.809707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c1f13029-c6f3-4218-8946-29beb3686170 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054823 Oct 04 14:34:25.810318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 357/686] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Oct 4 14:34:25 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:34:26.073328 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:26.074468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:26.085286 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.086182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.086984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.088295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.089219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.090017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.299430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:26.308698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e406aef2-665c-4fa8-b191-900213f328dd tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.243141 Oct 04 14:34:26.309613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 330/687] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:26 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:26.634154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:26.634730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:26.642991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.643706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.644163 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.644994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.645603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.646048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.704877 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:26.706164 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:26.713490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.713986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.714425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.715159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.715612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.716348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.723000 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:26.731383 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f577beb1-01c0-41cb-9c3a-aa14b7667525 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1293 microversion: 2.1 time: 0.101873 Oct 04 14:34:26.732451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 358/688] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:26 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:26.822356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:26.825765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:26.833901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.834478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.834975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.835750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:26.836289 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:26.837187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:26.875855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c0cad4d5-ea2e-450a-a62c-0b524cbadf6d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057544 Oct 04 14:34:26.876488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 359/689] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Oct 4 14:34:26 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 14:34:26.883286 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:26.894531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-00cf6f83-874c-41fe-bce3-a0f2943c46be tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.193345 Oct 04 14:34:26.895073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 331/690] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:26 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:27.334158 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:27.334867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:27.340918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.341610 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.342049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.342771 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.343238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.343662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.348096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:27.544382 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:27.553784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8c15aea6-22b8-46bd-af8b-e3a113c4864b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.223694 Oct 04 14:34:27.554513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 360/691] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:27 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:27.762118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:27.762742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:27.769764 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.770254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.770688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.771400 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.771913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.772353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.852091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:27.861824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5097e55a-b2e7-4b32-8850-0c1dc524dfa3 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1299 microversion: 2.1 time: 0.104276 Oct 04 14:34:27.862413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 332/692] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:27 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:27.888339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:27.890956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:27.897571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.898062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.898489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.899184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.899633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.900040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.919712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:27.920392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:27.927277 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.927923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.928435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.929101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:27.929388 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:27.929812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:27.940344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8e097ed9-0fed-46c6-a473-cf2c6f99f1a2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056459 Oct 04 14:34:27.941230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 361/693] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Oct 4 14:34:27 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:28.019490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:28.020531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:28.028524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.029195 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.029636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.030928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.031932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.032691 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.063788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:34:28.150695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d3592fe4-f56c-411b-83af-e9f693fb3427 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 204 len: 0 microversion: 2.20 time: 0.136221 Oct 04 14:34:28.151343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 362/694] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Oct 4 14:34:28 2022] DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 14:34:28.160849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:28.161552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:28.167962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.168560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.169001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.169706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.170159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.170580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.184654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:28.194322 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-164a6e28-ce05-49cb-bc4b-1527a8900205 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1737 microversion: 2.1 time: 0.278585 Oct 04 14:34:28.194914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 333/695] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:27 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1737 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:28.310686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:28.319881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:28.321364 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:28.322532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-03fa0b8c-5f77-4ed0-bffd-795cf5775f03 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.166449 Oct 04 14:34:28.323094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 363/696] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:28 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:28.581466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:28.582542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:28.592365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.593632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.594393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.595616 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.596274 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.597065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.599736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "436db2a5-39f5-411e-a721-093f36d2def9", "device": "/dev/sdb"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:28.604174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:28.611063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.611555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.612003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.612755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.613208 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.614289 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.953444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:28.961532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-44566799-52e6-4aec-a363-0a447e538e8a tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.386759 Oct 04 14:34:28.962057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 334/697] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:28 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:28.981879 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:28.982482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:28.990295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.990787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.991216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:28.991923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:28.992396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:28.992813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.072827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:29.080946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dcabf761-023b-45e1-8351-2196c0c09c78 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1299 microversion: 2.1 time: 0.103340 Oct 04 14:34:29.081643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 335/698] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:28 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:29.219971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:29.220625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:29.226804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.227300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.227731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.228461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.228983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.229412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.422002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:29.437341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5b48ea31-8afc-4e4c-b8ce-e15852b8c367 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1717 microversion: 2.1 time: 0.221314 Oct 04 14:34:29.439021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 336/699] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:29 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1717 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:29.444597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:29.445250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:29.458448 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.458947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.460961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.461837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.462384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.463257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.659846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:29.668890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:29.670324 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:29.671772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6870c893-1e82-4a67-ba12-09eb9b9b2dc5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.231052 Oct 04 14:34:29.672335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 337/700] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:29 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:29.677761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:29.678250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:29.684501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.690058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.690058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.690058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.690058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.690556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.779791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:29.785271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] HTTP exception thrown: Cannot 'detach_volume' instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 while it is in vm_state rescued Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Request method failure captured: Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments/df592fe3-713b-488d-ab81-bda5afdb198f HTTP/1.1 Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENd645BW0PdaWe-YwDoffCgwpYWCio58x6Ai1V3CQDWp9xhPbUjAW1BffH4YPXEQVQ_drSOgAgX41jji4KCaHWx4yCTkcysZ2k1XQjjdHZLHdsuNEsXAGreSCLKKPLJnooIoXNGtvB6_mJvjinDG11Hu96hUB2daSUFGkN6DasRMA8 Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:34:29.786898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec24f1b720bd42ebb37a36d65757aacd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 2b4c980bac3e444faa0e6f1a1d270cfa Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:34:29.788975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Cannot 'detach_volume' instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 while it is in vm_state rescued Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'server_id': '0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302', 'id': 'df592fe3-713b-488d-ab81-bda5afdb198f'} Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:34:29.789871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 while it is in vm_state rescued Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 while it is in vm_state rescued Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:34:29.791715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Returning 409 to user: Cannot 'detach_volume' instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 while it is in vm_state rescued {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:34:29.793189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-afc0caa6-bcd7-4944-82e8-954380a0c53c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments/df592fe3-713b-488d-ab81-bda5afdb198f" status: 409 len: 152 microversion: 2.1 time: 0.114719 Oct 04 14:34:29.793189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 338/701] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:34:29 2022] DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments/df592fe3-713b-488d-ab81-bda5afdb198f => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 14:34:29.798582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:29.799123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:29.805730 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.806222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.806662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.807380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.807838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.808268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.883902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dae595a9-cf53-4926-93b0-73e376df7711 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "POST /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/action" status: 202 len: 0 microversion: 2.1 time: 0.090221 Oct 04 14:34:29.884606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 339/702] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:34:29 2022] POST /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:34:29.895063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:29.896344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:29.903908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.904436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.904874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:29.906465 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:29.907135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:29.907569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:30.046416 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:30.056573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-683aa513-ea4e-4567-9eae-2f43a485b6b4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1725 microversion: 2.1 time: 0.167435 Oct 04 14:34:30.057153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 340/703] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:29 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:30.062125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:30.062718 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:30.068728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:30.069344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:30.069787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:30.070490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:30.070945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:30.071395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:30.217582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:30.226888 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7f8da910-6b83-482f-ac21-80743d566167 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.168618 Oct 04 14:34:30.227473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 341/704] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:30 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:30.232040 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:30.232739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:30.244977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:30.245316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:30.245762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:30.246442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:30.246917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:30.247306 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:30.589214 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:30.602664 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5b130159-8e61-4fbe-b205-385047f7a65e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.373800 Oct 04 14:34:30.603819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 342/705] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:30 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:30.701146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:30.702840 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:30.719505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-dadbf8f8-5765-498d-a30b-111339e619dd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "POST /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.127921 Oct 04 14:34:30.724591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 364/706] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:34:28 2022] POST /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0/os-volume_attachments => generated 194 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:30.733071 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:30.733907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:30.734441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:30.735241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:30.735777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:30.736500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.082185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:31.082799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:31.089570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.090230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.090711 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.091455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.091914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.092371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.248507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:31.261019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:31.265762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:31.267372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:31.268596 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a92f4b2b-0b26-434b-b5bb-456a0614efb6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.572817 Oct 04 14:34:31.269371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 343/707] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:30 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:31.281580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:31.283119 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:31.284170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-af62da32-55ac-4264-9215-a27402066165 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1725 microversion: 2.1 time: 0.206934 Oct 04 14:34:31.292301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.293073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.293980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.294895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.296953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.297413 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.298041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 365/708] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:31 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:31.545144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:31.556734 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-880f7d30-7828-4620-bc3a-70e5c1e996bc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.286210 Oct 04 14:34:31.557335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 344/709] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:31 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:31.627451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:31.628063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:31.634839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.635388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.635821 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.636581 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.637037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.637452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.795181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-c204865e-53ac-41f4-8490-3a5bcfe185e7 req-5893343d-b2e2-4556-8373-af37a5fc4ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd13e9a-f9e0-49d8-b173-d65efded21ed", "tag": "7a4d66ba-4ece-415d-8b95-8f071ff501b9"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:31.823648 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c204865e-53ac-41f4-8490-3a5bcfe185e7 req-5893343d-b2e2-4556-8373-af37a5fc4ead service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:31.824200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c204865e-53ac-41f4-8490-3a5bcfe185e7 req-5893343d-b2e2-4556-8373-af37a5fc4ead service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:31.824841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c204865e-53ac-41f4-8490-3a5bcfe185e7 req-5893343d-b2e2-4556-8373-af37a5fc4ead service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:31.888003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-c204865e-53ac-41f4-8490-3a5bcfe185e7 req-5893343d-b2e2-4556-8373-af37a5fc4ead service nova] Creating event network-changed:7a4d66ba-4ece-415d-8b95-8f071ff501b9 for instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed on hv-cinder-86026 Oct 04 14:34:31.900281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-c204865e-53ac-41f4-8490-3a5bcfe185e7 req-5893343d-b2e2-4556-8373-af37a5fc4ead service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112570 Oct 04 14:34:31.908367 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 345/710] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:31.990813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:32.000972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7e1bd755-5a20-4f7f-b9cf-860434a69207 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.377886 Oct 04 14:34:32.001560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 366/711] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:31 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:32.303794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:32.304509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:32.311435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:32.313792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:32.314617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:32.315470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:32.316944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:32.317755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:32.324304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:32.325206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:32.332143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:32.333067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:32.333617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:32.334436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:32.334994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:32.335518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:32.523109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:32.537081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c9cd19b4-07ac-4fd3-821d-f51d4f6648db tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1725 microversion: 2.1 time: 0.221699 Oct 04 14:34:32.538321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 367/712] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:32 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:32.583960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:32.583960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:32.590526 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:32.591110 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:32.591618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:32.592446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:32.593601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:32.594094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:32.640101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:32.648785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:32.650266 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:32.651453 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-39d05aab-662c-4224-ad75-efabfe010642 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1724 microversion: 2.20 time: 0.352027 Oct 04 14:34:32.652407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 346/713] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:32 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:32.742681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:32.752888 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8c1d0ff5-2498-44bc-8ad8-d6285b278b88 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.174357 Oct 04 14:34:32.754021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 368/714] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:32 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:33.024276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:33.025000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:33.032430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.033036 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.033425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.034146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.034634 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.035095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.328445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:33.336689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7850630e-d526-4aa8-9f77-cf142ebdcd50 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.316298 Oct 04 14:34:33.337272 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 347/715] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:33 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:33.571236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:33.571904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:33.574123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:33.574987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=22 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:33.581953 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.582832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.583615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.584906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.585924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.586513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.680070 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:33.680717 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:33.687833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.688351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.688977 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.689927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.690395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.690826 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.758951 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:33.760597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:33.768489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e83f485a-0fcd-4582-ad6f-34c7b2266ad8 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1725 microversion: 2.1 time: 0.204607 Oct 04 14:34:33.769611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 369/716] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:33 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:33.770054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:33.771507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:33.772813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f520c79f-c25c-412c-8c23-d61b5267150e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1656 microversion: 2.20 time: 0.096611 Oct 04 14:34:33.773538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 348/717] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:33 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:33.778893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:33.779712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:33.791619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.792039 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.792575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.793344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.793860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.794353 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.929396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-c43ce0ae-49f2-4625-9589-a4b9b42d0716 req-a55e47fa-58ed-4600-9aad-807e56b69e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "128c7edb-5a5c-4f1c-b3cc-efc3b3a00677", "name": "network-vif-deleted", "tag": "fdc4ad8e-1631-4821-915b-f8fee37479d7"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:33.942140 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c43ce0ae-49f2-4625-9589-a4b9b42d0716 req-a55e47fa-58ed-4600-9aad-807e56b69e14 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:33.943121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c43ce0ae-49f2-4625-9589-a4b9b42d0716 req-a55e47fa-58ed-4600-9aad-807e56b69e14 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:33.943825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c43ce0ae-49f2-4625-9589-a4b9b42d0716 req-a55e47fa-58ed-4600-9aad-807e56b69e14 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:33.946455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:33.956075 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2257a61d-0aa2-4fa6-8945-b5744b68f86d tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.181086 Oct 04 14:34:33.957165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 370/718] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:33 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:33.970428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-c43ce0ae-49f2-4625-9589-a4b9b42d0716 req-a55e47fa-58ed-4600-9aad-807e56b69e14 service nova] Creating event network-vif-deleted:fdc4ad8e-1631-4821-915b-f8fee37479d7 for instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 on hv-cinder-86026 Oct 04 14:34:33.975806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-c43ce0ae-49f2-4625-9589-a4b9b42d0716 req-a55e47fa-58ed-4600-9aad-807e56b69e14 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050068 Oct 04 14:34:33.976558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 349/719] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:34.363608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:34.364211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:34.370200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.370678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.371108 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.371794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.372241 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.372737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.571487 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:34.580478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4304ec25-c33c-4d74-ae64-8063788e8016 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.220656 Oct 04 14:34:34.581052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 371/720] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:34 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:34.798637 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:34.799342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:34.803301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:34.804117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:34.806606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.807737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.807737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.808239 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.808892 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.809318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.812751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.813536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.814249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.815084 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.815538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.816119 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.853132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.853548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.853987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.854462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lazy-loading 'fault' on Instance uuid 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:34.905172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:34.914600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:34.916065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:34.917305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-afa1ff63-0947-41b0-9e72-8d4daaebd3e9 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1371 microversion: 2.20 time: 0.118261 Oct 04 14:34:34.917886 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 372/721] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:34 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:34.958212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:34.968185 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4083965d-b1ed-4534-a496-eb10d1db92d0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1731 microversion: 2.1 time: 0.175867 Oct 04 14:34:34.968833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 350/722] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:34 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:34.979205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:34.979854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:34.986741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.987362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.987800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.988562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.989015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.989445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.990899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:34.991406 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:34.997632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.998131 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:34.998572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:34.999361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:34.999807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:35.000231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:35.010064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:35.102090 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dbed2ec9-1fb7-49a4-88c7-e3dd8c349bd7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115063 Oct 04 14:34:35.103376 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 351/723] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:34:34 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:35.161666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:35.169334 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-44f72ecd-c94b-48bd-bfa0-f235c51cb6af tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.194202 Oct 04 14:34:35.170065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 373/724] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:34 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:35.605705 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:35.605705 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:35.611381 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:35.611996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:35.612478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:35.613400 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:35.614045 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:35.614653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:35.860703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:35.868574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-067b35e3-45a5-4265-9c27-1b63cc9dee11 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.269255 Oct 04 14:34:35.869173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 352/725] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:35 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:35.943858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:35.944598 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:35.951116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:35.951600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:35.952142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:35.953407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:35.953851 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:35.954273 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:35.987720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:35.988377 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:35.988667 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:35.989112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lazy-loading 'fault' on Instance uuid 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:36.030597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:36.039618 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:36.041181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:36.042335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-224c1958-26a0-4802-8c5f-ff1f3e32468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1371 microversion: 2.20 time: 0.102472 Oct 04 14:34:36.042890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 374/726] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:35 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:36.194933 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-f219e05b-f961-4d40-97c2-5ba887de9cdb req-cf723a2c-5417-40c9-8648-6887fad61f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302", "tag": "31660410-8845-41c4-b49c-b89043507bb3"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:36.196289 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:36.196538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:36.208301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:36.209086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:36.209680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:36.211006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:36.212051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:36.213062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:36.214495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-f219e05b-f961-4d40-97c2-5ba887de9cdb req-cf723a2c-5417-40c9-8648-6887fad61f40 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:36.214978 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-f219e05b-f961-4d40-97c2-5ba887de9cdb req-cf723a2c-5417-40c9-8648-6887fad61f40 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:36.215401 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-f219e05b-f961-4d40-97c2-5ba887de9cdb req-cf723a2c-5417-40c9-8648-6887fad61f40 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:36.236073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-f219e05b-f961-4d40-97c2-5ba887de9cdb req-cf723a2c-5417-40c9-8648-6887fad61f40 service nova] Creating event network-changed:31660410-8845-41c4-b49c-b89043507bb3 for instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 on hv-cinder-86026 Oct 04 14:34:36.246969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-f219e05b-f961-4d40-97c2-5ba887de9cdb req-cf723a2c-5417-40c9-8648-6887fad61f40 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062732 Oct 04 14:34:36.248098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 353/727] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:36.359365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:36.368249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5492c9ae-3ae7-4c4e-946e-4fb3d7f05a1e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.179402 Oct 04 14:34:36.368780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 375/728] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:36 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:36.896155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:36.896811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:36.902985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:36.903546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:36.905231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:36.906373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:36.907148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:36.907572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.071526 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:37.072138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:37.087940 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:37.088362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:37.090244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.091167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:37.091635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:37.092060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.151877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:37.152422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:37.152869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.153332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lazy-loading 'fault' on Instance uuid 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:37.200566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:37.209916 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:37.211378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:37.212605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2e94240b-fbd8-444b-ad83-2bd2c58b9d4f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 200 len: 1371 microversion: 2.20 time: 0.146733 Oct 04 14:34:37.213170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 376/729] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:37 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:37.220206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-d5e2e509-a964-4b1c-9572-cd199dec567c req-892c3db8-ae0e-4d90-9ff8-4278200652d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "name": "network-vif-plugged", "status": "completed", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:37.232909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d5e2e509-a964-4b1c-9572-cd199dec567c req-892c3db8-ae0e-4d90-9ff8-4278200652d6 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:37.234387 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d5e2e509-a964-4b1c-9572-cd199dec567c req-892c3db8-ae0e-4d90-9ff8-4278200652d6 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:37.235036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d5e2e509-a964-4b1c-9572-cd199dec567c req-892c3db8-ae0e-4d90-9ff8-4278200652d6 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.252419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-d5e2e509-a964-4b1c-9572-cd199dec567c req-892c3db8-ae0e-4d90-9ff8-4278200652d6 service nova] Creating event network-vif-plugged:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:34:37.268898 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-d5e2e509-a964-4b1c-9572-cd199dec567c req-892c3db8-ae0e-4d90-9ff8-4278200652d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052755 Oct 04 14:34:37.277111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 377/730] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:37.392486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:37.393095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:37.399958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:37.400462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:37.400825 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.401545 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:37.401997 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:37.402421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:37.567680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:37.582320 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:37.585937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fc9524c3-657a-4b21-bd8e-b63edb30e99c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.197537 Oct 04 14:34:37.587590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 378/731] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:37 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:37.607569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b9d7f18c-46d0-4a06-9f9f-8796d7ff6a05 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.716130 Oct 04 14:34:37.624827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 354/732] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:36 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:38.243318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:38.243891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:38.251666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.252175 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.252643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.253343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.253801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.254220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.262309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-bc39bfa3-ec7e-437c-bd09-5f6c212eb901 req-f75388ff-02d4-4647-a127-28369defc710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302", "tag": "31660410-8845-41c4-b49c-b89043507bb3"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:38.270467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] HTTP exception thrown: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Request method failure captured: Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 HTTP/1.1 Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENgJ70YnIadHTqiCjhsslkU0jj2WY2RzIdTNIzfcnsr7swqjUY4YRUvAmKXi5gOYoDPw2S_lxwclaqe87wQOFnAeO-DK3UTqDkB8J0BkLpzV88YPlZuFE66-5PTOBUIGtDQzDAkSXbuIrtkY8x8C1mvoB83dSP14nl7zqD4ZKfGJVk Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:34:38.271532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64993786e21b45beb7829ceaede4777a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64993786e21b45beb7829ceaede4777a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: c5b38375d6ff4d0db0f3f7bc89ca8798 Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:34:38.274748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '128c7edb-5a5c-4f1c-b3cc-efc3b3a00677'} Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:34:38.275548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:34:38.276912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:38.279258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Returning 404 to user: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:34:38.279258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-774d8d54-1047-4b31-bc96-bd68afaead66 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 404 len: 111 microversion: 2.20 time: 0.033706 Oct 04 14:34:38.279258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 379/733] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:38 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:34:38.279513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-bc39bfa3-ec7e-437c-bd09-5f6c212eb901 req-f75388ff-02d4-4647-a127-28369defc710 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.279513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-bc39bfa3-ec7e-437c-bd09-5f6c212eb901 req-f75388ff-02d4-4647-a127-28369defc710 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.279513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-bc39bfa3-ec7e-437c-bd09-5f6c212eb901 req-f75388ff-02d4-4647-a127-28369defc710 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.283876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cef127a7-58bd-41ee-b9ab-04637e400bff tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '.version_select at 0x7f5718693940>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:38.291760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-bc39bfa3-ec7e-437c-bd09-5f6c212eb901 req-f75388ff-02d4-4647-a127-28369defc710 service nova] Creating event network-changed:31660410-8845-41c4-b49c-b89043507bb3 for instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 on hv-cinder-86026 Oct 04 14:34:38.297868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-bc39bfa3-ec7e-437c-bd09-5f6c212eb901 req-f75388ff-02d4-4647-a127-28369defc710 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039178 Oct 04 14:34:38.298581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 355/734] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:38.303915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cef127a7-58bd-41ee-b9ab-04637e400bff tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210054834" status: 204 len: 0 microversion: 2.20 time: 0.024475 Oct 04 14:34:38.304512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 380/735] 10.222.0.64 () {60 vars in 1259 bytes} [Tue Oct 4 14:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210054834 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 14:34:38.611269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:38.611974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:38.614013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:38.619529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.620013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.620478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.621181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.621632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.622055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.633810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:38.634633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:38.642517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.643281 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.643876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.644613 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:38.645228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:38.645732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:38.792681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:38.800516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ea71d0f4-cbfd-4dee-be4f-9685d2918979 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.173206 Oct 04 14:34:38.801086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 381/736] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:38 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:38.854620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:38.862284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-57308234-d3fd-47fe-a62e-7d09e426c688 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.256153 Oct 04 14:34:38.862854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 356/737] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:38 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:39.063319 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b91e23d2-1b5a-40b5-896f-93ceb2ffabbb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'create', calling method: .version_select at 0x7f57186ce160>, body: {"keypair": {"name": "tempest-keypair-1367836450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrgNrA8ILkf4cq8xHv9SSV3u+H7RcCK8X9lj+qrn+DkKQ12tdSr14MhGVhihZbD0elVeYbEKH0O2QqC5eZdlIiUfUC0JDY5fdCuV6OOWc5Nx2xVsL4ELX3sgH9d/K5jqw=="}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:39.079761 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-b91e23d2-1b5a-40b5-896f-93ceb2ffabbb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for project 64993786e21b45beb7829ceaede4777a. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:39.083472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-b91e23d2-1b5a-40b5-896f-93ceb2ffabbb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for user c5b38375d6ff4d0db0f3f7bc89ca8798 and project 64993786e21b45beb7829ceaede4777a. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:39.105637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b91e23d2-1b5a-40b5-896f-93ceb2ffabbb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046580 Oct 04 14:34:39.106229 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 382/738] 10.222.0.64 () {62 vars in 1200 bytes} [Tue Oct 4 14:34:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 14:34:39.823139 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:39.824600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:39.831617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:39.832102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:39.832603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:39.833353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:39.833757 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:39.834240 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:39.853825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:39.886511 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:39.887141 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:39.897647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:39.898462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:39.899242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:39.900193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:39.901067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:39.901809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:40.012268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:40.020842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-90091c97-452b-4920-a90b-9d5af78ef6ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.201427 Oct 04 14:34:40.022234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 357/739] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:39 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:40.139318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:40.148027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-62d7ed12-c76b-452a-9dff-e91ee61c77f0 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.265063 Oct 04 14:34:40.148643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 383/740] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:39 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:40.582654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-947055583", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8adffcb3-eb41-48c9-bdc6-30a7213ac01c"}], "security_groups": [{"name": "tempest-securitygroup--1989406495"}], "key_name": "tempest-keypair-1367836450", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:40.691169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] validate_networks() for [('8adffcb3-eb41-48c9-bdc6-30a7213ac01c', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:34:41.043566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:41.044165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:41.050684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:41.051161 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:41.051596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:41.052291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:41.053548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:41.053970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:41.202329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:41.211552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-272df16d-7bc2-4551-981d-bfe35c8599d2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.171899 Oct 04 14:34:41.212255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 384/741] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:41 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:41.217402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:41.218662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:41.225351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:41.226155 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:41.226939 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:41.227919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:41.228892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:41.229680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:41.258159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:34:41.259195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:34:41.259931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:34:41.260598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:34:41.261020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:34:41.271151 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:41.271635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:41.272066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:41.272828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:41.273273 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:41.273686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:41.292786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for project 64993786e21b45beb7829ceaede4777a. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:41.296914 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Getting quotas for user c5b38375d6ff4d0db0f3f7bc89ca8798 and project 64993786e21b45beb7829ceaede4777a. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:41.308362 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:34:41.310687 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:34:41.362667 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a46fbf9a-fe79-418e-8b7c-9027f144751b tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.784349 Oct 04 14:34:41.363895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 358/742] 10.222.0.64 () {62 vars in 1188 bytes} [Tue Oct 4 14:34:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 14:34:41.375032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:41.375213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9b6694f3-cb41-4be5-8ac1-4d8f181014b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:41.375836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9b6694f3-cb41-4be5-8ac1-4d8f181014b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:41.393508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3c8e3fd2-dbba-4a72-b3d0-22b28cf75e5b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1358 microversion: 2.1 time: 0.179802 Oct 04 14:34:41.393911 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 385/743] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:41 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:41.435734 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9b6694f3-cb41-4be5-8ac1-4d8f181014b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:41.445189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9b6694f3-cb41-4be5-8ac1-4d8f181014b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:41.446625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9b6694f3-cb41-4be5-8ac1-4d8f181014b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:41.448210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9b6694f3-cb41-4be5-8ac1-4d8f181014b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1281 microversion: 2.20 time: 0.077614 Oct 04 14:34:41.449166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 359/744] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:41 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:42.234736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:42.235376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:42.242304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.242790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.243225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.243926 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.244409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.244837 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.386850 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.395455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9dadf5bf-4446-4065-9ec1-ab567596e9cc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.164708 Oct 04 14:34:42.396031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 386/745] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:42 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:42.417075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:42.417685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:42.425013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.425535 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.425987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.426694 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.427144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.427570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.474702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:42.475316 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:42.481300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.481779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.482210 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.482984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.483437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.484040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.552052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.561822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.563975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.564662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.565125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-49427ce9-0f1c-4771-890e-4f412d67f124 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1285 microversion: 2.20 time: 0.094393 Oct 04 14:34:42.565685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 387/746] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:42 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:42.573050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3da27826-88a6-43e7-b469-54fe7ee1f864 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1548 microversion: 2.1 time: 0.159848 Oct 04 14:34:42.573633 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 360/747] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:42 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:42.596186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:42.596824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:42.598813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:42.604120 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.604632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.605065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.605765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.606216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.606636 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.762692 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.771542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c1aceba0-d986-450a-83c4-01dbabd73e32 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1548 microversion: 2.1 time: 0.179137 Oct 04 14:34:42.772142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 388/748] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:42 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:42.794841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:42.800908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:42.801704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Searching by: {'deleted': False, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee'} {{(pid=120820) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 14:34:42.808691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.809178 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.809613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.810342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:42.810845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:42.811285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:42.909715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.multi_cell_list [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120820) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 14:34:43.019373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-845a4ccf-f0d0-4bda-8086-70aaac5a2973 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.228175 Oct 04 14:34:43.019879 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 361/749] 10.222.0.64 () {58 vars in 1125 bytes} [Tue Oct 4 14:34:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:43.032351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:43.032974 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:43.039221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:43.039716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:43.040145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:43.040887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:43.041338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:43.041756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:43.180583 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:43.190126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c10214ea-3462-4b1d-9e69-3874ee090ab2 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1548 microversion: 2.1 time: 0.162274 Oct 04 14:34:43.190995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 389/750] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:43 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:43.419251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:43.419848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:43.427811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:43.428281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:43.428964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:43.429741 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:43.430276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:43.430752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:43.593016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:43.594130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:43.601148 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:43.601635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:43.602067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:43.602869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:43.603436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:43.603853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:43.604812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:43.615719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-de2157fa-67fe-49c3-b5d5-63fba12bec39 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.200120 Oct 04 14:34:43.625344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 362/751] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:43 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:43.678260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:43.684621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:43.686128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:43.687274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-925ab601-c9e6-4e00-b5ce-5e1f48afb491 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1285 microversion: 2.20 time: 0.100097 Oct 04 14:34:43.687835 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 390/752] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:43 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:44.644089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:44.644955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:44.651466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:44.651955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:44.652414 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:44.653126 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:44.653586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:44.654007 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:44.714095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:44.715496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:44.723518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:44.724009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:44.724480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:44.725197 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:44.725657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:44.726081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:44.794334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:44.802843 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-12266515-7ae1-48c9-92ad-34de6d49780d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.163967 Oct 04 14:34:44.803426 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 363/753] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:44 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:44.812509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:44.821631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:44.823064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:44.824173 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9b164419-8704-4d9b-8fa7-7a7059fb0137 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1285 microversion: 2.20 time: 0.115319 Oct 04 14:34:44.824781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 391/754] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:44 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:45.322673 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-d5a031e1-4e9f-4e95-acff-da73117dbc29 req-31be77ac-4ae1-4bde-a088-c9314906d375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd13e9a-f9e0-49d8-b173-d65efded21ed", "name": "network-vif-plugged", "status": "completed", "tag": "7a4d66ba-4ece-415d-8b95-8f071ff501b9"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:45.336486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d5a031e1-4e9f-4e95-acff-da73117dbc29 req-31be77ac-4ae1-4bde-a088-c9314906d375 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.337201 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d5a031e1-4e9f-4e95-acff-da73117dbc29 req-31be77ac-4ae1-4bde-a088-c9314906d375 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.337963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d5a031e1-4e9f-4e95-acff-da73117dbc29 req-31be77ac-4ae1-4bde-a088-c9314906d375 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:45.357428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-d5a031e1-4e9f-4e95-acff-da73117dbc29 req-31be77ac-4ae1-4bde-a088-c9314906d375 service nova] Creating event network-vif-plugged:7a4d66ba-4ece-415d-8b95-8f071ff501b9 for instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed on hv-cinder-86026 Oct 04 14:34:45.365411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-d5a031e1-4e9f-4e95-acff-da73117dbc29 req-31be77ac-4ae1-4bde-a088-c9314906d375 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046781 Oct 04 14:34:45.367104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 364/755] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:45.827104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:45.827719 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:45.835650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.837245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.837245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:45.837556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.838017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.838578 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:45.863992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:45.865530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:45.875318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.876106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.877358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:45.878752 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.879811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.880737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:45.960537 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:45.972363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:45.975210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:45.976068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6ebe28bd-868d-42f6-a5b8-60c3314b68fd tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.125660 Oct 04 14:34:45.976782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 365/756] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:45 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:45.982231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf907a63-3faf-47f0-9610-9c4714053bb8"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:45.984898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:45.991291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.991793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.992229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:45.993186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:45.993425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:45.993852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:46.018261 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:46.022028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:46.028198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2d858617-f86b-4ce4-85fb-1cf6128d68f2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.205008 Oct 04 14:34:46.028895 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 392/757] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:45 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:47.003542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:47.004415 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:47.011354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:47.011846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:47.012474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:47.013344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:47.014664 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:47.015111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:47.091557 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:47.100279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:47.101778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:47.103107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-87455e05-e56d-4c2e-952a-22d464c6b5de tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.103924 Oct 04 14:34:47.103716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 393/758] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:46 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:47.109059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:47.109817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:47.117282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:47.117829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:47.118270 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:47.118991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:47.119442 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:47.119871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:47.306388 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:47.315194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7794e826-85e2-48d9-8662-b79e71f74523 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.210429 Oct 04 14:34:47.315906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 394/759] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:47 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:48.118486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 14:34:48.119147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Tue Oct 4 14:34:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments (ip 10.222.0.64) !!! Oct 04 14:34:48.130012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:48.130655 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:48.137562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:48.138055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:48.138494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:48.139305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:48.139959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:48.140432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:48.207284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:48.216507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:48.218760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:48.220036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-95a43b0a-6729-4972-b032-add5cd5eabaa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.093956 Oct 04 14:34:48.220485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 395/760] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:48 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:48.338719 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:48.339328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:48.345449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:48.345933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:48.346371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:48.347066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:48.347520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:48.347943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:48.491299 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:48.499812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3029f983-0db6-449a-b69d-97e8e8f3bbda tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.164869 Oct 04 14:34:48.500422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 396/761] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:48 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:49.245910 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:49.246602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:49.249014 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=4 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:49.254714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.255271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.255701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.256419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.256867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.257284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.321334 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:49.330477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:49.332499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:49.333620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e17f24e3-2b4f-482c-8efa-e86b4b2f42e2 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.091627 Oct 04 14:34:49.334385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 397/762] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:49 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:49.505739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0b5978b1-5553-4abf-894a-58f7dd30a4b5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.524725 Oct 04 14:34:49.505739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 366/763] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:34:45 2022] POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 194 bytes in 3526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:49.524334 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:49.525062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:49.539847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.541940 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.543089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.547520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.549500 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.550421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.681756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:49.684248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:49.695253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.696039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.696653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.697747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.698332 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.698917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.733993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c4227256-37f8-4467-951c-ac8cee504120 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067926 Oct 04 14:34:49.734662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 367/764] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:34:49 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 14:34:49.746906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:49.755996 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-22705799-053c-4045-b1b8-2d1157ff0587 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1366 microversion: 2.1 time: 0.236930 Oct 04 14:34:49.756746 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 398/765] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:49 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:49.804401 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:49.804891 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:49.811972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.812503 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.812935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.813643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.814092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.814535 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.842787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:34:49.928656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ac77a53d-7150-47f3-a5c0-e943dc924c1f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 204 len: 0 microversion: 2.1 time: 0.128040 Oct 04 14:34:49.929238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 368/766] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:34:49 2022] DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:34:49.937677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:49.938547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:49.945369 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.945853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.946306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:49.946998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:49.947455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:49.947877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:50.080872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:50.088596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-10c3a49f-a75c-437b-8a6e-f8c4e1422e0c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1674 microversion: 2.1 time: 0.155038 Oct 04 14:34:50.089160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 399/767] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:49 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:50.360263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:50.361042 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:50.367750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:50.368241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:50.368706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:50.369417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:50.369875 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:50.370301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:50.434926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:50.444482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:50.445941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:50.447083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-24e8e72c-cb06-4cd8-85d2-5a630d5815f0 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.091349 Oct 04 14:34:50.447868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 369/768] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:50 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:50.780409 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:50.781287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:50.788880 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:50.789394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:50.789881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:50.790892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:50.791347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:50.791780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:50.929940 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:50.938322 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ca7da274-fa74-4fc1-9eb8-d22f7cfd3451 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1555 microversion: 2.1 time: 0.161772 Oct 04 14:34:50.938890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 400/769] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:50 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:50.960724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:50.961247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:50.968282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:50.968812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:50.969246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:50.969954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:50.970405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:50.970827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:51.056753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e9f42c3f-2e5a-42e1-acd8-d422f5193a5f tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099640 Oct 04 14:34:51.057654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 370/770] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:34:50 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:51.112038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:51.112693 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:51.119176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:51.119668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:51.120107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:51.120848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:51.121298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:51.121725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:51.362012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:51.369948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e0aa4f1c-1961-40f1-abca-c7483536cb03 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1674 microversion: 2.1 time: 0.262169 Oct 04 14:34:51.370524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 401/771] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:51 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1674 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:34:51.475177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=8 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:51.479715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:51.480340 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:51.487911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:51.488447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:51.488889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:51.489640 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:51.490090 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:51.490512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:51.574618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:51.583140 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:51.584611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:51.585724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7566c387-9624-44d6-a60d-0cca2394fb4c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.111501 Oct 04 14:34:51.586305 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 371/772] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:51 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:52.399998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:52.400836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:52.412923 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:52.413449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:52.413890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:52.414632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:52.415088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:52.415925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:52.436428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-5390c12f-c09a-4589-a2ef-08db1584ed66 req-4dab7d39-0bf4-435b-83d0-2e8eebaf0365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd13e9a-f9e0-49d8-b173-d65efded21ed", "tag": "7a4d66ba-4ece-415d-8b95-8f071ff501b9"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:52.448919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5390c12f-c09a-4589-a2ef-08db1584ed66 req-4dab7d39-0bf4-435b-83d0-2e8eebaf0365 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:52.449412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5390c12f-c09a-4589-a2ef-08db1584ed66 req-4dab7d39-0bf4-435b-83d0-2e8eebaf0365 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:52.449841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5390c12f-c09a-4589-a2ef-08db1584ed66 req-4dab7d39-0bf4-435b-83d0-2e8eebaf0365 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:52.463729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-5390c12f-c09a-4589-a2ef-08db1584ed66 req-4dab7d39-0bf4-435b-83d0-2e8eebaf0365 service nova] Creating event network-changed:7a4d66ba-4ece-415d-8b95-8f071ff501b9 for instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed on hv-cinder-86026 Oct 04 14:34:52.470393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-5390c12f-c09a-4589-a2ef-08db1584ed66 req-4dab7d39-0bf4-435b-83d0-2e8eebaf0365 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037555 Oct 04 14:34:52.471611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 372/773] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:52.598588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:52.606728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8006fb00-9baf-4020-ac87-dff5be8175b6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1674 microversion: 2.1 time: 0.213616 Oct 04 14:34:52.607318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 402/774] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:52 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:52.675266 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:52.675986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:52.682944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:52.683438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:52.683880 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:52.684638 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:52.685122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:52.685588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:52.754268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:52.763237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:52.765265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:52.766531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c9231a5e-f1c9-4502-86fe-0d0331a77505 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1333 microversion: 2.20 time: 0.159163 Oct 04 14:34:52.767110 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 373/775] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:52 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1333 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:53.631472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:53.632074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:53.639006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:53.639498 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:53.639931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:53.640680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:53.641133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:53.641558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:53.783159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:53.791393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-adecc0e7-71b9-4ac4-8266-fdb6b8edb903 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1674 microversion: 2.1 time: 0.163689 Oct 04 14:34:53.791960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 403/776] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:53 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:53.793524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:53.794310 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:53.798462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:53.802891 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:53.803380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:53.803813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:53.804577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:53.805044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:53.805567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:53.811552 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:34:53.927397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:53.928015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:53.934771 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:53.935270 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:53.936299 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:53.937061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:53.937513 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:53.937935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:54.071396 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'services' on Instance uuid 6f7e1d84-2636-4738-a919-b595b40b8ca0 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:54.137705 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:54.147864 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:54.150005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:54.151166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6b35df8f-d08b-4285-a5ce-ea8a9bf4abf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1341 microversion: 2.20 time: 0.361616 Oct 04 14:34:54.151941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 374/777] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:53 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1341 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:34:54.161707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bc57b092-1737-4a6a-8d55-eedb04bdad1e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0/os-volume_attachments/436db2a5-39f5-411e-a721-093f36d2def9" status: 202 len: 0 microversion: 2.1 time: 0.238058 Oct 04 14:34:54.162309 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 404/778] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:34:53 2022] DELETE /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0/os-volume_attachments/436db2a5-39f5-411e-a721-093f36d2def9 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:34:54.832108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:54.833542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:54.839799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:54.840606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:54.841962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:54.843067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:54.843535 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:54.843970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:54.924116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:54.949361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2d9e2942-eea0-48f0-91ee-1fda975cbbdc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1606 microversion: 2.1 time: 0.120537 Oct 04 14:34:54.950423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 375/779] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:54 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1606 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:55.178765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:55.180097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:55.196547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:55.197476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:55.198846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:55.200735 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:55.202197 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:55.202964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:55.418832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-189b1bb2-5d55-4de8-886e-e0f630d2cf16 req-0a29d590-067d-4700-977d-b636f603b1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d55b4f-410d-4527-a9d3-15f1942a46d0", "name": "network-vif-deleted", "tag": "4f9df3e5-1e5c-45b5-9628-2769911f67a4"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:55.452408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-189b1bb2-5d55-4de8-886e-e0f630d2cf16 req-0a29d590-067d-4700-977d-b636f603b1ae service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:55.457961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-189b1bb2-5d55-4de8-886e-e0f630d2cf16 req-0a29d590-067d-4700-977d-b636f603b1ae service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:55.461297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-189b1bb2-5d55-4de8-886e-e0f630d2cf16 req-0a29d590-067d-4700-977d-b636f603b1ae service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:55.521430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-189b1bb2-5d55-4de8-886e-e0f630d2cf16 req-0a29d590-067d-4700-977d-b636f603b1ae service nova] Creating event network-vif-deleted:4f9df3e5-1e5c-45b5-9628-2769911f67a4 for instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 on hv-cinder-86026 Oct 04 14:34:55.531124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-189b1bb2-5d55-4de8-886e-e0f630d2cf16 req-0a29d590-067d-4700-977d-b636f603b1ae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114062 Oct 04 14:34:55.533399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 376/780] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:34:55.604958 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:55.615173 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:55.616986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:55.618602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e1090353-1493-4c0c-a6d5-f86351f4a2cf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.444378 Oct 04 14:34:55.619685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 405/781] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:55 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:55.977382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:55.977950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:55.984838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:55.985342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:55.985785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:55.986783 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:55.987253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:55.987868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:56.041172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:56.042184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:56.043743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:56.044501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 52d55b4f-410d-4527-a9d3-15f1942a46d0 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:34:56.108766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:56.119332 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fa1d9bbd-f01e-42e1-98f0-12db9d5ddd05 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 200 len: 1328 microversion: 2.1 time: 0.147553 Oct 04 14:34:56.119966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 377/782] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:55 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 1328 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:34:56.620393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-ca9219dc-212d-406d-b4b0-896e319859ad req-4cf4f395-4a93-430d-9f32-a7f073dd41c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:56.638178 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-ca9219dc-212d-406d-b4b0-896e319859ad req-4cf4f395-4a93-430d-9f32-a7f073dd41c5 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:56.639514 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-ca9219dc-212d-406d-b4b0-896e319859ad req-4cf4f395-4a93-430d-9f32-a7f073dd41c5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:56.641244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-ca9219dc-212d-406d-b4b0-896e319859ad req-4cf4f395-4a93-430d-9f32-a7f073dd41c5 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:56.653940 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:56.656515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:56.658167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-ca9219dc-212d-406d-b4b0-896e319859ad req-4cf4f395-4a93-430d-9f32-a7f073dd41c5 service nova] Creating event network-changed:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:34:56.665834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-ca9219dc-212d-406d-b4b0-896e319859ad req-4cf4f395-4a93-430d-9f32-a7f073dd41c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050574 Oct 04 14:34:56.668380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 406/783] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:56.686163 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:56.687937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:56.688778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:56.689529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:56.689993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:56.690442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:56.924593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:56.933061 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:56.934518 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:56.936231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b7a12c7d-f5fb-4528-a386-e13edb477456 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.290152 Oct 04 14:34:56.936829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 378/784] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:56 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:57.145099 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:57.146077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:57.152441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:57.152931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:57.153362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:57.154761 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:57.155563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:57.156297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:57.171270 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] HTTP exception thrown: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Request method failure captured: Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 HTTP/1.1 Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENlUieDFIvtQ-j8JoX6PIJbf76a2YWuw2B7dat7Y14d-P8pYVyKoZGRHwcRUSdjgCfGLvEhlgsOJN3Y2xmcJuUhnwuh9PI9JygsMctaaf2CSH62k4yOVQ19rtgH9SkOcofD4hgMw69hIe-1kjFBUcWOOWwKMwavfjO8y8ucQVTLX_I Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:34:57.173031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a4fa5d0aa0e4bf98816e4600023ca99", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fc02bb4b8a32400faef8743d2418a648 Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:34:57.174556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '52d55b4f-410d-4527-a9d3-15f1942a46d0'} Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:34:57.175863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:34:57.177187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:34:57.178459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Returning 404 to user: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:34:57.178459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ba761712-40da-4e7d-b674-bf007ecf6434 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 404 len: 111 microversion: 2.1 time: 0.033489 Oct 04 14:34:57.178459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 407/785] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:34:57 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:34:57.184611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7c64066c-18df-4f62-a90e-91f40a725019 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '.version_select at 0x7f5718661790>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:57.209441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7c64066c-18df-4f62-a90e-91f40a725019 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021671863" status: 202 len: 0 microversion: 2.1 time: 0.029294 Oct 04 14:34:57.210025 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 379/786] 10.222.0.64 () {58 vars in 1221 bytes} [Tue Oct 4 14:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021671863 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:34:57.864223 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-03f07a35-423e-47d4-a8ca-4b82893050c2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: .version_select at 0x7f5718630ca0>, body: {"keypair": {"name": "tempest-keypair-506639375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJq4TEDLmSM9QE20tD/OF/AD++yGebqgdgHR49HzR1In5c1Ac3fGOrxz3xYvMHnYAsUW1Bczd4SiDpEg1BgKUf02MEGTuJ+qh7yvqMcyZ7+jtCe+gl6+dy/ayp4bjA15Q=="}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:57.881143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-03f07a35-423e-47d4-a8ca-4b82893050c2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:57.884972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-03f07a35-423e-47d4-a8ca-4b82893050c2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for user fc02bb4b8a32400faef8743d2418a648 and project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:57.910037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-03f07a35-423e-47d4-a8ca-4b82893050c2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049703 Oct 04 14:34:57.910632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 408/787] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:34:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:34:57.962056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:57.962776 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:57.969442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:57.970020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:57.970548 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:57.971329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:57.971791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:57.972222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:58.161022 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:58.173767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:58.175237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:58.176428 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-81b4cccf-d1cd-4f62-8c92-bd4a38a49beb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.218382 Oct 04 14:34:58.177092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 380/788] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:57 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:59.205165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:34:59.206435 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:34:59.213066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:59.213623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:59.214237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:59.214961 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:59.215463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:59.215857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:59.364512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-391463540", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c224c131-1e09-47f0-b40a-1a73221baea0"}], "security_groups": [{"name": "tempest-securitygroup--754693637"}], "key_name": "tempest-keypair-506639375", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:34:59.366688 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:59.375516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:59.380278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:34:59.380278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-617c8ddc-5a33-479c-9d31-5ec5a60d6de8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.178509 Oct 04 14:34:59.380278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 409/789] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:34:59 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:34:59.486511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] validate_networks() for [('c224c131-1e09-47f0-b40a-1a73221baea0', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:34:59.939138 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:34:59.939966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:34:59.940819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:34:59.941267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:34:59.941689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:34:59.953651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:59.954153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:59.954594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:59.960364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:34:59.960364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:34:59.960364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:34:59.974543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:34:59.979360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Getting quotas for user fc02bb4b8a32400faef8743d2418a648 and project 3a4fa5d0aa0e4bf98816e4600023ca99. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:34:59.990930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:34:59.993351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:35:00.042859 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-078d0ae0-4058-46eb-9a57-e8b228ff7ffb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682780 Oct 04 14:35:00.043519 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 381/790] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:34:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:35:00.055692 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4926de23-0a6a-4065-aefd-9fe261118f64 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:00.056298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4926de23-0a6a-4065-aefd-9fe261118f64 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:00.142847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4926de23-0a6a-4065-aefd-9fe261118f64 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:00.150435 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4926de23-0a6a-4065-aefd-9fe261118f64 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1236 microversion: 2.1 time: 0.098533 Oct 04 14:35:00.151005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 410/791] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:00 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:00.403432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:00.404784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:00.412433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:00.413050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:00.413491 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:00.414238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:00.414691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:00.415173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:00.547755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:00.548591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:00.556955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:00.557564 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:00.558304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:00.559263 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:00.559957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:00.561300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:00.588256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:00.600233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:00.602563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:00.604077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7dced4fa-4ccd-450e-825c-c5f1f5925aab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.204896 Oct 04 14:35:00.605510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 382/792] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:35:00 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:35:00.737670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:00.746118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-635414c8-d99b-4dcb-b53f-7121cd63ebf7 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1594 microversion: 2.1 time: 0.204391 Oct 04 14:35:00.747011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 411/793] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:00 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1594 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:01.175574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:01.176176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:01.187846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:01.190213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:01.193327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:01.194404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:01.195102 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:01.195689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:01.392017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:01.402866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9325d255-4a3e-4e93-8557-16cfc196466f tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1288 microversion: 2.1 time: 0.231363 Oct 04 14:35:01.404232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 383/794] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:01 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1288 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:01.637080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:01.637676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:01.644496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:01.644981 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:01.645420 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:01.646126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:01.646614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:01.647035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:01.651552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:01.845707 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:01.846210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:01.849070 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:01.854762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:01.855218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:01.855575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:01.856337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:01.856810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:01.857860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:01.880132 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:01.889690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:01.891614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:01.893045 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fd10b47e-c082-4319-9d3b-9c52a6d0b1d5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.259971 Oct 04 14:35:01.893605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 412/795] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:35:01 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:35:01.896813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:35:02.026014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b4b6681b-7a95-42a4-a6ae-7af9b072d307 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 204 len: 0 microversion: 2.1 time: 0.184012 Oct 04 14:35:02.027101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 384/796] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:35:01 2022] DELETE /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:35:02.041320 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:02.042369 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:02.051601 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:02.052930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:02.053694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:02.054826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:02.055554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:02.056140 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:02.302784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:02.311895 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d3831781-cb1b-4bc1-9930-9a553403901f tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1513 microversion: 2.1 time: 0.278746 Oct 04 14:35:02.312685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 413/797] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:02 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:02.427722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:02.428521 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:02.435228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:02.435228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:02.435632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:02.436576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:02.437033 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:02.437461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:02.503716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:02.511978 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d1367101-0eca-4ecd-88f9-a8c1cd0bfa8c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1306 microversion: 2.1 time: 0.088499 Oct 04 14:35:02.512669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 385/798] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:02 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:02.930019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:02.930660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:02.938847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:02.939343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:02.939781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:02.940528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:02.940983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:02.941412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.147729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-d1fddda1-b863-4084-8bac-cd7f8b36321a req-38891182-882f-4f7d-b38d-7b4798872186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:03.147978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:03.160148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d1fddda1-b863-4084-8bac-cd7f8b36321a req-38891182-882f-4f7d-b38d-7b4798872186 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:03.160840 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d1fddda1-b863-4084-8bac-cd7f8b36321a req-38891182-882f-4f7d-b38d-7b4798872186 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:03.161500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-d1fddda1-b863-4084-8bac-cd7f8b36321a req-38891182-882f-4f7d-b38d-7b4798872186 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.165537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:03.168077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:03.168077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-29549b23-fdb0-4a44-a1e2-d1e1619d2cce tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.242020 Oct 04 14:35:03.174601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-d1fddda1-b863-4084-8bac-cd7f8b36321a req-38891182-882f-4f7d-b38d-7b4798872186 service nova] Creating event network-changed:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:35:03.180434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-d1fddda1-b863-4084-8bac-cd7f8b36321a req-38891182-882f-4f7d-b38d-7b4798872186 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036976 Oct 04 14:35:03.181386 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 386/799] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:03.189500 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 414/800] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:35:02 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:35:03.339932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:03.342098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:03.356019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:03.358771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:03.359474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.360591 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:03.361287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:03.361921 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.420861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-b3088574-c0f7-42db-883a-9655f675112d req-a05522d2-2255-4fef-b90e-b4025f1d18a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "name": "network-vif-plugged", "status": "completed", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:03.437504 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-b3088574-c0f7-42db-883a-9655f675112d req-a05522d2-2255-4fef-b90e-b4025f1d18a1 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:03.444368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-b3088574-c0f7-42db-883a-9655f675112d req-a05522d2-2255-4fef-b90e-b4025f1d18a1 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:03.445125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-b3088574-c0f7-42db-883a-9655f675112d req-a05522d2-2255-4fef-b90e-b4025f1d18a1 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.474145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-b3088574-c0f7-42db-883a-9655f675112d req-a05522d2-2255-4fef-b90e-b4025f1d18a1 service nova] Creating event network-vif-plugged:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:35:03.479684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-b3088574-c0f7-42db-883a-9655f675112d req-a05522d2-2255-4fef-b90e-b4025f1d18a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063518 Oct 04 14:35:03.481340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 415/801] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:03.543193 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:03.543875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:03.559175 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:03.561717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:03.562499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.563570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:03.564253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:03.565713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:03.618510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:03.629345 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4101c11a-e71c-4eb1-b9e4-28468d742367 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1513 microversion: 2.1 time: 0.296485 Oct 04 14:35:03.630041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 387/802] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:03 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:03.665298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:03.675103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fc97de67-9d73-4cdf-85db-10e2877322fb tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1306 microversion: 2.1 time: 0.141686 Oct 04 14:35:03.676147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 416/803] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:03 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1306 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:04.195081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:04.195690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:04.203370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.203963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.204441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.205983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.206609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.207039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.595588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:04.604908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:04.606595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:04.608499 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-434b274a-57fa-429e-8080-0ee0bd6f496e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.417599 Oct 04 14:35:04.609312 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 388/804] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:35:04 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:35:04.656279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:04.657090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:04.666040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.666741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.667198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.668134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.668862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.670200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.699667 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:04.701449 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:04.708576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.709405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.710063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.711068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.711778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.712447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.963424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:04.973705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4a0a12e5-e696-4364-aa00-8bbfbf71ae66 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1513 microversion: 2.1 time: 0.322830 Oct 04 14:35:04.988445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 417/805] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:04 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:04.988445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-819710087"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:04.988445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:04.988445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.988984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.989367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:04.990371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:04.990942 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:04.991547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:05.101685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:05.110817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c65535f2-ad0b-49ee-92ab-c73fc85804d7 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1294 microversion: 2.1 time: 0.415284 Oct 04 14:35:05.111970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 389/806] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:04 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1294 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:05.195254 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.network.security_group_api [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Adding security group bc570813-e84d-4bd0-aa5f-a8c0b290be17 to port 15011792-a2ae-4555-bb5e-f16eac3afea0 Oct 04 14:35:05.352017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-fcd3b46e-90c9-41b4-b611-69868abfc99a req-0101771d-3e66-450b-88f3-f2e045a95de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7e1d84-2636-4738-a919-b595b40b8ca0", "name": "network-vif-deleted", "tag": "94339d45-a083-4b8d-984f-7ad2590b96fd"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:05.364460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-fcd3b46e-90c9-41b4-b611-69868abfc99a req-0101771d-3e66-450b-88f3-f2e045a95de4 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:05.365028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-fcd3b46e-90c9-41b4-b611-69868abfc99a req-0101771d-3e66-450b-88f3-f2e045a95de4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:05.365601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-fcd3b46e-90c9-41b4-b611-69868abfc99a req-0101771d-3e66-450b-88f3-f2e045a95de4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:05.378515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-fcd3b46e-90c9-41b4-b611-69868abfc99a req-0101771d-3e66-450b-88f3-f2e045a95de4 service nova] Creating event network-vif-deleted:94339d45-a083-4b8d-984f-7ad2590b96fd for instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 on hv-cinder-86026 Oct 04 14:35:05.386072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-fcd3b46e-90c9-41b4-b611-69868abfc99a req-0101771d-3e66-450b-88f3-f2e045a95de4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037919 Oct 04 14:35:05.387000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 390/807] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:05.640955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:05.640955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:05.643731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:05.644276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:05.644904 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:05.645722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:05.646710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:05.647379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:05.666018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4ec0aceb-3c63-46bc-86ea-53ca715ec6ab tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/action" status: 202 len: 0 microversion: 2.1 time: 0.690460 Oct 04 14:35:05.668070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 418/808] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:35:04 2022] POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:35:05.683575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:05.688202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:05.723079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:05.727441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:05.728293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:05.735727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:05.736640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:05.737215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:05.916485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:05.924576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:05.928014 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-04fba3ba-4777-4cf2-aafe-ce240eeef243 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1640 microversion: 2.1 time: 0.255040 Oct 04 14:35:05.935995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:05.938372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:05.940503 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4c2fd506-4523-42ca-a2f0-e78595ed2161 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1407 microversion: 2.20 time: 0.310383 Oct 04 14:35:05.941666 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 391/809] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:35:05 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:35:05.959029 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 419/810] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:05 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1640 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:06.002743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:06.003876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:06.014656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.016263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.016967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.017956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.019051 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.020091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.053926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:06.071986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.072780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.073384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.074107 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'fault' on Instance uuid 6f7e1d84-2636-4738-a919-b595b40b8ca0 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:06.142127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:06.143092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:06.149772 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.150401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.151777 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.152631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.153230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.154441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.174485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:06.201703 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-63933dd6-e6e1-4bcd-bb34-7d4f2e66850b tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1308 microversion: 2.1 time: 0.206396 Oct 04 14:35:06.202966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 392/811] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:05 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:06.321874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:06.334211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0e9f5ae7-fe21-4972-ba81-0918d4fa58ac tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.196449 Oct 04 14:35:06.335104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 420/812] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:06 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:06.744162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-7938ecba-6b7b-48c5-aace-179cc08a7fa8 req-0fb283f2-6a62-4364-9111-956a9b84e363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5dac79-f96d-476e-afb9-50602d68e5ae", "tag": "e72efce6-2833-4437-98f6-0d6dbe747184"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:06.756370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-7938ecba-6b7b-48c5-aace-179cc08a7fa8 req-0fb283f2-6a62-4364-9111-956a9b84e363 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.757201 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-7938ecba-6b7b-48c5-aace-179cc08a7fa8 req-0fb283f2-6a62-4364-9111-956a9b84e363 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.758027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-7938ecba-6b7b-48c5-aace-179cc08a7fa8 req-0fb283f2-6a62-4364-9111-956a9b84e363 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.769846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-7938ecba-6b7b-48c5-aace-179cc08a7fa8 req-0fb283f2-6a62-4364-9111-956a9b84e363 service nova] Creating event network-changed:e72efce6-2833-4437-98f6-0d6dbe747184 for instance 1a5dac79-f96d-476e-afb9-50602d68e5ae on hv-cinder-86026 Oct 04 14:35:06.775412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-7938ecba-6b7b-48c5-aace-179cc08a7fa8 req-0fb283f2-6a62-4364-9111-956a9b84e363 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035331 Oct 04 14:35:06.777775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 393/813] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:06.971846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:06.972715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:06.980046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.980562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.980989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:06.982776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:06.983458 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:06.984052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.131902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:07.140562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:07.142009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:07.143158 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b00a744d-b605-4fed-82f8-bad5f8b136a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1600 microversion: 2.20 time: 0.175817 Oct 04 14:35:07.143724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 421/814] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:35:06 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:35:07.170559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:07.171129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:07.177373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.177860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.178302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.179000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.179476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.179900 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.226134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:07.226882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:07.234147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.234663 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.235098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.235795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.236274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.236901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.263565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-36b87a51-f1cf-4b77-b697-742bd9b5304c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097674 Oct 04 14:35:07.264403 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 394/815] 10.222.0.64 () {60 vars in 1316 bytes} [Tue Oct 4 14:35:07 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:35:07.272812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.272812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.272812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.272812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'fault' on Instance uuid 6f7e1d84-2636-4738-a919-b595b40b8ca0 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:07.357253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:07.359743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:07.360410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:07.367638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1551d340-5e33-42ea-95c4-e64eb0a4a0fc tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 200 len: 1308 microversion: 2.1 time: 0.145589 Oct 04 14:35:07.368912 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 422/816] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:07 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:07.369518 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.370159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.370724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.371816 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.372963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.373791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.429904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-656365b2-e13a-4ce7-8d4f-128a0ea53a1f req-a0a0284c-f4d3-4ea6-98fe-074d6f53af5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:07.440274 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-656365b2-e13a-4ce7-8d4f-128a0ea53a1f req-a0a0284c-f4d3-4ea6-98fe-074d6f53af5d service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:07.441059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-656365b2-e13a-4ce7-8d4f-128a0ea53a1f req-a0a0284c-f4d3-4ea6-98fe-074d6f53af5d service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:07.441661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-656365b2-e13a-4ce7-8d4f-128a0ea53a1f req-a0a0284c-f4d3-4ea6-98fe-074d6f53af5d service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:07.460994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-656365b2-e13a-4ce7-8d4f-128a0ea53a1f req-a0a0284c-f4d3-4ea6-98fe-074d6f53af5d service nova] Creating event network-changed:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:35:07.468871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-656365b2-e13a-4ce7-8d4f-128a0ea53a1f req-a0a0284c-f4d3-4ea6-98fe-074d6f53af5d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042160 Oct 04 14:35:07.469787 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 423/817] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:07.721814 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:07.733825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-94710baf-99bc-48cf-9f41-2dc2c6b3beef tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.379314 Oct 04 14:35:07.735095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 395/818] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:07 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:08.393982 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:08.394679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 6f7e1d84-2636-4738-a919-b595b40b8ca0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:08.400919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:08.401402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:08.401836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:08.402527 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:08.402983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:08.403403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:08.418128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] HTTP exception thrown: Instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 could not be found. Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Request method failure captured: Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 HTTP/1.1 Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPERPhPBEjLwrW--eTOguc0EBcTF5Mz_Wl9hBLKs720aPUdE9r-CF6TS3DaY4GLv42W21F8XtkK1Xwg2DCjkFsTHW8j8qTIRm3l1BrTFx2CuUmDfbLQ1_MbBoRhhtcheeRh8YIMPK8c4xzi1voQv4SMi14ZHCwmkBRtQQPBfzhP47wno Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 742e9ad0995f4f96bcc1f75f5689a590 Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesSnapshotTestJSON-441376065 Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:35:08.420591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/742e9ad0995f4f96bcc1f75f5689a590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_742e9ad0995f4f96bcc1f75f5689a590", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/742e9ad0995f4f96bcc1f75f5689a590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/742e9ad0995f4f96bcc1f75f5689a590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesSnapshotTestJSON-441376065 Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 742e9ad0995f4f96bcc1f75f5689a590 Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-441376065 Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesSnapshotTestJSON-441376065-project Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 6ec52681fc41477e92786ad61aa96a76 Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesSnapshotTestJSON-441376065-project Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 could not be found. Oct 04 14:35:08.423550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '6f7e1d84-2636-4738-a919-b595b40b8ca0'} Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 could not be found. Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:35:08.425919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 could not be found. Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 could not be found. Oct 04 14:35:08.428694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:08.430990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Returning 404 to user: Instance 6f7e1d84-2636-4738-a919-b595b40b8ca0 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:35:08.430990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-55e082f8-5149-4e6f-8f40-9a00a76d85f5 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0" status: 404 len: 111 microversion: 2.1 time: 0.032737 Oct 04 14:35:08.430990 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 424/819] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:08 2022] GET /compute/v2.1/servers/6f7e1d84-2636-4738-a919-b595b40b8ca0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:35:08.757285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:08.757901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:08.765110 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:08.765608 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:08.766046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:08.766758 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:08.767243 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:08.771478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:08.910371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:08.918192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-88f262d4-82d7-4144-8f0f-33067eac1dd2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.164775 Oct 04 14:35:08.918778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 396/820] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:08 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:09.488129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-14c36e53-1075-439e-a9d3-068f4e9bcd50 req-782fee3f-9451-4d8e-9a7d-99b3d9835e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:09.498595 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-14c36e53-1075-439e-a9d3-068f4e9bcd50 req-782fee3f-9451-4d8e-9a7d-99b3d9835e6d service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:09.499157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-14c36e53-1075-439e-a9d3-068f4e9bcd50 req-782fee3f-9451-4d8e-9a7d-99b3d9835e6d service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:09.499486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-14c36e53-1075-439e-a9d3-068f4e9bcd50 req-782fee3f-9451-4d8e-9a7d-99b3d9835e6d service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:09.510790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-14c36e53-1075-439e-a9d3-068f4e9bcd50 req-782fee3f-9451-4d8e-9a7d-99b3d9835e6d service nova] Creating event network-changed:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:35:09.516035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-14c36e53-1075-439e-a9d3-068f4e9bcd50 req-782fee3f-9451-4d8e-9a7d-99b3d9835e6d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031551 Oct 04 14:35:09.516660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 425/821] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:09.941847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:09.942419 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:09.948997 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:09.949484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:09.949927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:09.951275 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:09.951740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:09.952171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:09.967809 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:09.986285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=6 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:10.092955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:10.106897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-25c78687-7dd8-4b61-8b8a-95104abc730a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.168866 Oct 04 14:35:10.107673 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 397/822] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:09 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:11.130041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:11.130739 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:11.132738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=6 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:11.138815 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:11.139331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:11.139769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:11.140499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:11.140960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:11.141380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:11.292074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:11.300344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-432ebd18-4a5a-424d-a0c7-c80ccdcdfd42 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.174651 Oct 04 14:35:11.303670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 426/823] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:11 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:12.322998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:12.323637 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:12.330944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:12.331435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:12.331872 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:12.332603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:12.333061 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:12.333489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:12.532886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:12.547452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-908044e0-46ae-4537-8475-a4b4dfb66095 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.227894 Oct 04 14:35:12.548210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 398/824] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:12 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:13.319454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:13.320452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:13.322468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:13.329055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:13.329631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:13.330065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:13.330816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:13.331258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:13.331673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:13.359712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:35:13.438393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8336595e-d13c-48dc-a9be-27fa32708e32 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 204 len: 0 microversion: 2.1 time: 0.122598 Oct 04 14:35:13.439300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 427/825] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:35:13 2022] DELETE /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:35:13.448737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:13.449344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:13.456516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:13.456852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:13.457293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:13.458009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:13.458469 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:13.458900 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:13.572723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:13.573356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:13.580763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:13.581298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:13.581737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:13.582489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:13.582946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:13.583376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:13.604775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:13.613459 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-004c5feb-0e5d-48b4-8a87-6d430267a4b9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1579 microversion: 2.1 time: 0.169976 Oct 04 14:35:13.614048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 399/826] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:13 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:13.725236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:13.733859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-31c60b6f-beb6-4fb2-941f-8d9bec8dc4bc tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.165721 Oct 04 14:35:13.734443 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 428/827] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:13 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:14.636985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:14.637528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:14.644729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:14.645220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:14.645663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:14.646379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:14.646836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:14.647262 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:14.757185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:14.757909 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:14.764389 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:14.764873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:14.765310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:14.766012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:14.766464 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:14.766885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:14.787975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:14.797226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c054fe82-8a8d-4cc5-bd40-c1b19dca396b tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1579 microversion: 2.1 time: 0.164144 Oct 04 14:35:14.798054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 400/828] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:14 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:14.915177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:14.918791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:14.924681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-edadf2b6-f135-4215-9c2b-2fb76eec6a53 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.171436 Oct 04 14:35:14.925259 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 429/829] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:14 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:15.822292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:15.822918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:15.829875 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:15.830358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:15.830792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:15.831495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:15.831942 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:15.834009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:15.948412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:15.949130 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:15.958012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:15.958650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:15.959084 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:15.959783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:15.960242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:15.961255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:15.972804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:15.982029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a9c5c042-0625-4e01-9e7e-a796f23c4262 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1579 microversion: 2.1 time: 0.163090 Oct 04 14:35:15.982719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 401/830] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:15 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:16.098212 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:16.106151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-381b7a6b-45e3-4b44-8207-adee52bd84a2 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.161619 Oct 04 14:35:16.107291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 430/831] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:15 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:17.006697 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:17.007347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:17.014012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:17.014489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:17.014924 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:17.015625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:17.016072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:17.016526 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:17.129717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:17.130552 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:17.138932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:17.139424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:17.139878 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:17.140992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:17.141113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:17.141465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:17.152421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:17.161348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cb611629-dd14-413b-bec1-e684bb8593ca tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1579 microversion: 2.1 time: 0.158549 Oct 04 14:35:17.161937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 402/832] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:17 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:17.345661 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1842410699", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "networks": [{"uuid": "43cb4147-4d5f-4bad-9d73-94e85a7a487f"}]}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:17.412593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] validate_networks() for [('43cb4147-4d5f-4bad-9d73-94e85a7a487f', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:35:17.540726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:17.558748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-38dea3fc-ac41-4421-8dc1-dadadf5be9fd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.433500 Oct 04 14:35:17.559589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 431/833] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:17 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:17.805724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:35:17.806169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:35:17.806648 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:35:17.807055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:35:17.807457 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:35:17.818121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:17.818594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:17.819025 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:17.819756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:17.820209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:17.821343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:17.839720 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Getting quotas for project 742e9ad0995f4f96bcc1f75f5689a590. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:35:17.845425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Getting quotas for user 6ec52681fc41477e92786ad61aa96a76 and project 742e9ad0995f4f96bcc1f75f5689a590. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:35:17.857355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:35:17.859781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:35:17.905940 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fa9265cc-fbdf-4c89-8b81-173395bbe8a9 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564653 Oct 04 14:35:17.906595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 403/834] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:35:17.917720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f1b9db14-0c43-4efc-b582-36b029d144b2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:17.918332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f1b9db14-0c43-4efc-b582-36b029d144b2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:17.971942 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f1b9db14-0c43-4efc-b582-36b029d144b2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:17.979049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f1b9db14-0c43-4efc-b582-36b029d144b2 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1219 microversion: 2.1 time: 0.065162 Oct 04 14:35:17.979934 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 432/835] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:17 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:18.193882 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:18.196177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:18.210723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:18.211970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:18.212622 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:18.213863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:18.214263 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-d662b8f8-acbd-4464-8373-4418e8e83818 req-22da0903-26ea-4c78-9b40-efa70f45338b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5dac79-f96d-476e-afb9-50602d68e5ae", "name": "network-vif-plugged", "status": "completed", "tag": "e72efce6-2833-4437-98f6-0d6dbe747184"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:18.214742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:18.215116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:18.236880 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d662b8f8-acbd-4464-8373-4418e8e83818 req-22da0903-26ea-4c78-9b40-efa70f45338b service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:18.238268 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d662b8f8-acbd-4464-8373-4418e8e83818 req-22da0903-26ea-4c78-9b40-efa70f45338b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:18.239004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d662b8f8-acbd-4464-8373-4418e8e83818 req-22da0903-26ea-4c78-9b40-efa70f45338b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:18.256571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-d662b8f8-acbd-4464-8373-4418e8e83818 req-22da0903-26ea-4c78-9b40-efa70f45338b service nova] Creating event network-vif-plugged:e72efce6-2833-4437-98f6-0d6dbe747184 for instance 1a5dac79-f96d-476e-afb9-50602d68e5ae on hv-cinder-86026 Oct 04 14:35:18.266108 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-d662b8f8-acbd-4464-8373-4418e8e83818 req-22da0903-26ea-4c78-9b40-efa70f45338b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055356 Oct 04 14:35:18.267471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 433/836] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:18.583315 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:18.584045 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:18.591831 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:18.592355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:18.592779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:18.593497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:18.593944 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:18.594368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:18.785161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:18.792919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:18.793448 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-95d1e1e9-310b-4194-911f-57b0d21a00ff tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1579 microversion: 2.1 time: 0.608361 Oct 04 14:35:18.802726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-368be863-429e-434f-a858-cb755301c657 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.223687 Oct 04 14:35:18.803301 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 434/837] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:18 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:18.808663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 404/838] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:18 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1579 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:19.003749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:19.004381 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:19.010970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.011886 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.012716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.013707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.014169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.014606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.086521 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:19.096248 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7522589e-818a-441a-92f6-4369c6b8c368 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1271 microversion: 2.1 time: 0.098038 Oct 04 14:35:19.097012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 435/839] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:18 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:19.410005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-8d5ae0ac-df73-4267-874b-6b7bfd49d17e req-11f97d24-c8f7-4720-8ee3-0cfc9a2616d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7710c92-4b84-4095-8986-a3bc34164760", "name": "network-vif-deleted", "tag": "e54a5c10-31ed-49db-be6e-46142100601f"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:19.421159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-8d5ae0ac-df73-4267-874b-6b7bfd49d17e req-11f97d24-c8f7-4720-8ee3-0cfc9a2616d8 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.421646 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-8d5ae0ac-df73-4267-874b-6b7bfd49d17e req-11f97d24-c8f7-4720-8ee3-0cfc9a2616d8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.422083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-8d5ae0ac-df73-4267-874b-6b7bfd49d17e req-11f97d24-c8f7-4720-8ee3-0cfc9a2616d8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.434166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-8d5ae0ac-df73-4267-874b-6b7bfd49d17e req-11f97d24-c8f7-4720-8ee3-0cfc9a2616d8 service nova] Creating event network-vif-deleted:e54a5c10-31ed-49db-be6e-46142100601f for instance e7710c92-4b84-4095-8986-a3bc34164760 on hv-cinder-86026 Oct 04 14:35:19.442172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-8d5ae0ac-df73-4267-874b-6b7bfd49d17e req-11f97d24-c8f7-4720-8ee3-0cfc9a2616d8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105222 Oct 04 14:35:19.442952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 405/840] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:19.817625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:19.819211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:19.827476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.828054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.828625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.829411 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.830079 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.830592 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.833915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:19.839189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:19.861621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.862858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.863634 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.865229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:19.866277 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:19.867350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:19.904704 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:19.913597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b35f8260-5aa1-4b24-a87c-f5604b5d3714 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1226 microversion: 2.1 time: 0.100001 Oct 04 14:35:19.914265 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 436/841] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:19 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:20.022817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:20.032430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f61e62e5-8cfc-4d9b-bf77-e9ebb8ff39f6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1361 microversion: 2.1 time: 0.209158 Oct 04 14:35:20.032945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 406/842] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:19 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:20.121978 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:20.123169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:20.131332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:20.131892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:20.132586 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:20.133383 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:20.133840 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:20.134262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:20.205971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:20.216962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8f838558-dde8-408e-ac93-b3e1f0d4b9ec tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1271 microversion: 2.1 time: 0.097711 Oct 04 14:35:20.217970 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 437/843] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:20 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:20.937424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:20.938051 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:20.945104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:20.945599 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:20.946038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:20.946757 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:20.947220 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:20.947650 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:20.982934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:20.983423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:20.983864 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:20.984337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lazy-loading 'fault' on Instance uuid e7710c92-4b84-4095-8986-a3bc34164760 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:21.033303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:21.042948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-988a3788-a6d4-4a49-b9f2-d4a2787028f3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1231 microversion: 2.1 time: 0.110102 Oct 04 14:35:21.043579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 407/844] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:20 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:21.054955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:21.055554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:21.062628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:21.063107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:21.063543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:21.064231 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:21.064700 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:21.065114 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:21.209032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:21.218572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-dd5825a0-99cf-487e-a85a-2a2ca24247c6 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1546 microversion: 2.1 time: 0.167344 Oct 04 14:35:21.219224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 438/845] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:21 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:21.241749 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:21.242784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:21.243418 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:21.243925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:21.250344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:21.251207 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:21.251696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:21.252129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:21.252349 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:21.252936 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:21.253230 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:21.253774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:21.253893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:21.254247 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:21.254676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:21.254959 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:21.346423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0240833c-1960-4d34-8195-3c2df155dc2c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107033 Oct 04 14:35:21.348379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 439/846] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:35:21 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:21.358985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:21.367668 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1aea4437-fb0f-4de0-b63e-2466e96529fd tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1279 microversion: 2.1 time: 0.130723 Oct 04 14:35:21.368717 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 408/847] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:21 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1279 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:22.067275 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:22.067900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:22.074419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:22.075054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:22.075484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:22.076218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:22.076709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:22.077149 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:22.111217 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:22.111703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:22.112138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:22.112610 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lazy-loading 'fault' on Instance uuid e7710c92-4b84-4095-8986-a3bc34164760 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:22.154600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:22.163165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9a87acd8-926f-470e-9d40-a213985e56bc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 200 len: 1231 microversion: 2.1 time: 0.100302 Oct 04 14:35:22.163758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 440/848] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:22 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:22.394835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:22.395742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:22.401893 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:22.402383 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:22.402819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:22.404084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:22.404562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:22.404985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:22.508954 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:22.518753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-380597ac-7857-4a5a-8b0c-a62eae23902a tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1277 microversion: 2.1 time: 0.127930 Oct 04 14:35:22.519440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 409/849] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:22 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:22.955993 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-865b83f6-6500-4ef2-a7d0-f0f7f20c46e4 req-4d001640-a197-48a2-82dc-46485bd2edac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5dac79-f96d-476e-afb9-50602d68e5ae", "tag": "e72efce6-2833-4437-98f6-0d6dbe747184"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:22.969566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-865b83f6-6500-4ef2-a7d0-f0f7f20c46e4 req-4d001640-a197-48a2-82dc-46485bd2edac service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:22.970511 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-865b83f6-6500-4ef2-a7d0-f0f7f20c46e4 req-4d001640-a197-48a2-82dc-46485bd2edac service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:22.971342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-865b83f6-6500-4ef2-a7d0-f0f7f20c46e4 req-4d001640-a197-48a2-82dc-46485bd2edac service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:22.988446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-865b83f6-6500-4ef2-a7d0-f0f7f20c46e4 req-4d001640-a197-48a2-82dc-46485bd2edac service nova] Creating event network-changed:e72efce6-2833-4437-98f6-0d6dbe747184 for instance 1a5dac79-f96d-476e-afb9-50602d68e5ae on hv-cinder-86026 Oct 04 14:35:22.995856 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-865b83f6-6500-4ef2-a7d0-f0f7f20c46e4 req-4d001640-a197-48a2-82dc-46485bd2edac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044420 Oct 04 14:35:22.997646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 441/850] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:23.193370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:23.194365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:23.203852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:23.205002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:23.205635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:23.208539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:23.210279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:23.210766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:23.230294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] HTTP exception thrown: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Request method failure captured: Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 HTTP/1.1 Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEO2-to1CtDnHGa6mtD2SwxCCzwqpDY4-HJqtrALWXJY0j-tuErw3Xr6ZTWewABRSTZrVWddkpbZ8eOzCeEtqrE_jT0-pkJ1HhY8UR0wfh_nZzLUF8zWb024zog1gYmyPMCIXsNORM64XtvwePZ7OWfiNvUn7R1kQW9FFcpgouRyBU4 Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:35:23.233561 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_408b16a582484c619ff17416990d5feb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/408b16a582484c619ff17416990d5feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: c7028d2ccede4b44b567387bb83c4579 Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:35:23.236155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': 'e7710c92-4b84-4095-8986-a3bc34164760'} Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:35:23.237349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:35:23.238991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:23.241597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Returning 404 to user: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:35:23.242488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9c0f6c5b-cc32-4b69-9b74-a3cf91643da2 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 404 len: 111 microversion: 2.1 time: 0.054493 Oct 04 14:35:23.243243 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 410/851] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:23 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 14:35:23.379496 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-206784901", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1694566594", "security_groups": [{"name": "tempest-secgroup-smoke-2039710880"}], "block_device_mapping_v2": [{"uuid": "8db933b1-dab0-4650-8b80-77bb3eb71f66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4116101e-9cfb-4512-a759-154f86437ec3"}]}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:23.544064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:23.545813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:23.555997 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:23.573349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:23.573883 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:23.574723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:23.575761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:23.576422 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:23.611291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:23.696666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.network.neutron [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] validate_networks() for [('4116101e-9cfb-4512-a759-154f86437ec3', None, None, None, None, None)] {{(pid=120821) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:35:23.845838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:23.858215 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9ab4f5ec-5f84-4deb-94af-72c30d7a94b7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.318657 Oct 04 14:35:23.859115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 411/852] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:23 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:23.866728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:23.867815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:23.876216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:23.877109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:23.877728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:23.878446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:23.878909 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:23.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:24.010198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'services' on Instance uuid 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:24.121613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-20496815-0d18-4dc4-821d-cce2163d15d3 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments/df592fe3-713b-488d-ab81-bda5afdb198f" status: 202 len: 0 microversion: 2.1 time: 0.260701 Oct 04 14:35:24.123602 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 412/853] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:35:23 2022] DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments/df592fe3-713b-488d-ab81-bda5afdb198f => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:35:24.132355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:24.135089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:24.142425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:24.143218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:24.146776 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:24.147919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:24.148806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:24.149555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:24.186895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9d942280-ec69-4a59-9e4e-e65442180dda tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059690 Oct 04 14:35:24.192361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 413/854] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:24 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:24.312575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Flavor limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:35:24.312999 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Image limits 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:35:24.313501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Flavor pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:35:24.313908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Image pref 0:0:0 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:35:24.314316 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.virt.hardware [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:35:24.325303 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:24.325786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:24.326220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:24.326983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:24.327476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:24.328008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:24.346494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for project 408b16a582484c619ff17416990d5feb. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:35:24.350845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for user c7028d2ccede4b44b567387bb83c4579 and project 408b16a582484c619ff17416990d5feb. Resources: {'instances', 'ram', 'cores'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:35:24.414509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Going to run 1 instances... {{(pid=120821) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:35:24.416752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8db933b1-dab0-4650-8b80-77bb3eb71f66',volume_size=None,volume_type=None)] {{(pid=120821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:35:24.555828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5a8452a9-2c46-4529-8822-52cf21bb3b46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.182945 Oct 04 14:35:24.556804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 442/855] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:35:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:35:24.569214 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f16f5e85-7613-4585-8bdf-2aef2bf132ec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:24.570018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f16f5e85-7613-4585-8bdf-2aef2bf132ec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:24.629172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f16f5e85-7613-4585-8bdf-2aef2bf132ec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:24.640677 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f16f5e85-7613-4585-8bdf-2aef2bf132ec tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1094 microversion: 2.1 time: 0.075113 Oct 04 14:35:24.641643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 414/856] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:24 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:24.886531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:24.887065 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:24.894322 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:24.894817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:24.895258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:24.896412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:24.896857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:24.897337 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:25.027423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-9a34146b-651c-413f-acb1-0bc80bcd4109 req-e42268d9-8459-469b-b7e1-d09ef61580a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2295516e-70cf-4d19-b2f9-ac828a22000f", "tag": "1d559ed8-89f8-4e6f-a8eb-f50f0e9e1804"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:25.038845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-9a34146b-651c-413f-acb1-0bc80bcd4109 req-e42268d9-8459-469b-b7e1-d09ef61580a7 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:25.039331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-9a34146b-651c-413f-acb1-0bc80bcd4109 req-e42268d9-8459-469b-b7e1-d09ef61580a7 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:25.039749 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-9a34146b-651c-413f-acb1-0bc80bcd4109 req-e42268d9-8459-469b-b7e1-d09ef61580a7 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:25.051513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-9a34146b-651c-413f-acb1-0bc80bcd4109 req-e42268d9-8459-469b-b7e1-d09ef61580a7 service nova] Creating event network-changed:1d559ed8-89f8-4e6f-a8eb-f50f0e9e1804 for instance 2295516e-70cf-4d19-b2f9-ac828a22000f on hv-cinder-86026 Oct 04 14:35:25.056439 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-9a34146b-651c-413f-acb1-0bc80bcd4109 req-e42268d9-8459-469b-b7e1-d09ef61580a7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Oct 04 14:35:25.057373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 415/857] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:25.064424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:25.072571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a5695ff5-6beb-4492-a189-1de380da9aa7 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.190547 Oct 04 14:35:25.073167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 443/858] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:24 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:25.200234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:25.202660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:25.209053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:25.209545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:25.209991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:25.210711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:25.211165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:25.211597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:25.243631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c5da7200-4904-4da1-9a2d-36cab82093bd tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047982 Oct 04 14:35:25.244212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 416/859] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:25 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:25.679072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:25.679701 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:25.686395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:25.686887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:25.687387 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:25.688103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:25.688646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:25.689090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:25.754518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:25.762470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d9aa420b-00de-4c9f-b00b-e0425face1a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1144 microversion: 2.1 time: 0.087303 Oct 04 14:35:25.763110 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 444/860] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:25 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:26.097881 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:26.098628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:26.106137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:26.107347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:26.107819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:26.108581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:26.109036 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:26.109478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:26.257616 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:26.260268 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:26.267096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:26.267738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:26.268560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:26.269370 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:26.269933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:26.270364 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:26.295109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:26.303259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-eef03f72-769e-4846-8a33-14414a2a5598 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.209314 Oct 04 14:35:26.303850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 417/861] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:26 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:26.320302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2ecdeaca-5061-41f1-a5c8-83c0c136d943 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066310 Oct 04 14:35:26.321499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 445/862] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:26 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:26.790625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:26.791254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:26.798669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:26.799181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:26.799550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:26.800269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:26.800793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:26.801225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:26.877739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:26.888799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d60f5698-685e-4071-acf1-12f95f8f4ae9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1192 microversion: 2.1 time: 0.102429 Oct 04 14:35:26.889611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 418/863] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:26 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:27.326458 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:27.327038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:27.333904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.334141 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:27.334623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.334805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.335505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.335952 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.336394 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:27.336542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.343257 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.343751 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.344193 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.344946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.345405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.345835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.378078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9529f02b-e3b4-4a46-a589-a9b937b1886c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047857 Oct 04 14:35:27.378671 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 419/864] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:27 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 14:35:27.472642 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:27.473477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:27.479964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.480809 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.482740 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.483508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.485963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.485963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.498399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:27.506651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8b0dfdc4-c828-4f46-ae5a-5b82fab1f5ea tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.184320 Oct 04 14:35:27.511170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 446/865] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:27 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:27.519464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:35:27.587961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:27.607525 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-971abef8-b11a-475f-a46c-e19eedc99391 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 204 len: 0 microversion: 2.1 time: 0.138035 Oct 04 14:35:27.608304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 420/866] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:35:27 2022] DELETE /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 14:35:27.616807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:27.617442 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:27.623629 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.624110 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.624757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.625452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.625899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.626319 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.772797 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:27.781702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ea2df1a8-a4db-4e71-8d85-eaf937c3f077 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1691 microversion: 2.1 time: 0.168664 Oct 04 14:35:27.782291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 447/867] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:27 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:27.917987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:27.918715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:27.921507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:27.927281 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.927780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.928222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:27.928964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:27.929425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:27.929849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:28.001309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:28.011302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1e42c4fb-15b9-414f-a0bc-9eb0a1bffe2c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1210 microversion: 2.1 time: 0.097504 Oct 04 14:35:28.011927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 421/868] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:27 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:28.531784 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:28.533108 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:28.540238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:28.540741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:28.541203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:28.541874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:28.542365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:28.542731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:28.695439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:28.704346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-093213ce-4ec3-4eba-afe5-31718f9a8538 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.177134 Oct 04 14:35:28.704997 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 448/869] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:28 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:28.807045 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:28.807659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:28.816452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:28.817003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:28.817434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:28.818153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:28.818624 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:28.819041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:28.955144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:28.962994 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-30e040ce-1473-4238-81a2-acbdca40c96a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1691 microversion: 2.1 time: 0.161317 Oct 04 14:35:28.963566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 422/870] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:28 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:29.035430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:29.036044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:29.042150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:29.042626 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:29.043053 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:29.043731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:29.044716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:29.045129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:29.065114 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:29.112260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:29.120126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e2acc13b-0f69-4d36-abed-c867c209ff23 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1210 microversion: 2.1 time: 0.088733 Oct 04 14:35:29.120722 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 449/871] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:29 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:29.728195 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:29.728744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:29.735533 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:29.736020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:29.736490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:29.737181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:29.737636 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:29.738059 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:29.870998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:29.879708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dc172c78-c9c5-46b0-930f-c3a198f63155 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.155513 Oct 04 14:35:29.880304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 423/872] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:29 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:29.987259 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:29.987814 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:29.993817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:29.994289 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:29.994719 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:29.995400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:29.995852 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:29.996266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:30.137328 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:30.144487 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:30.145108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:30.152182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:30.152850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:30.153421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:30.154628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:30.155374 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:30.156011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:30.157303 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d0caa27a-4440-4c0f-91ea-6c6928bc26c0 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1691 microversion: 2.1 time: 0.174291 Oct 04 14:35:30.158089 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 450/873] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:29 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:30.228031 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:30.236481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-c328b8ff-d2a0-4990-8db6-5ca14cce94c1 req-4ae2057d-9b87-4360-a35a-d20daf7d3945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2295516e-70cf-4d19-b2f9-ac828a22000f", "name": "network-vif-plugged", "status": "completed", "tag": "1d559ed8-89f8-4e6f-a8eb-f50f0e9e1804"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:30.237754 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-06072506-f9dd-4f3a-9e58-855fcf702968 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1210 microversion: 2.1 time: 0.097676 Oct 04 14:35:30.238502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 424/874] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:30 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:30.249146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-c328b8ff-d2a0-4990-8db6-5ca14cce94c1 req-4ae2057d-9b87-4360-a35a-d20daf7d3945 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:30.249780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-c328b8ff-d2a0-4990-8db6-5ca14cce94c1 req-4ae2057d-9b87-4360-a35a-d20daf7d3945 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:30.250471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-c328b8ff-d2a0-4990-8db6-5ca14cce94c1 req-4ae2057d-9b87-4360-a35a-d20daf7d3945 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:30.265656 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-c328b8ff-d2a0-4990-8db6-5ca14cce94c1 req-4ae2057d-9b87-4360-a35a-d20daf7d3945 service nova] Creating event network-vif-plugged:1d559ed8-89f8-4e6f-a8eb-f50f0e9e1804 for instance 2295516e-70cf-4d19-b2f9-ac828a22000f on hv-cinder-86026 Oct 04 14:35:30.271565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-c328b8ff-d2a0-4990-8db6-5ca14cce94c1 req-4ae2057d-9b87-4360-a35a-d20daf7d3945 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040600 Oct 04 14:35:30.272275 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 451/875] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:30.903069 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:30.904671 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:30.911648 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:30.912149 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:30.912628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:30.913337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:30.913797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:30.914225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:31.052584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:31.060675 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3de07649-2754-4614-8d30-2b7b8e38d34e tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.161437 Oct 04 14:35:31.061263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 425/876] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:30 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:31.181878 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:31.182481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:31.189580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:31.190052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:31.190478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:31.191165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:31.191606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:31.192047 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:31.263539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:31.264202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:31.270952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:31.270952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:31.271311 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:31.272041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:31.272501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:31.272935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:31.337788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:31.346861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7ef500c7-6d9f-4a65-bb40-ac4fed06af8e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1691 microversion: 2.1 time: 0.169692 Oct 04 14:35:31.347448 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 452/877] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:31 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:31.359241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:31.367651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-19d48a0c-c85c-427c-b486-3a4eef3e889e tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1210 microversion: 2.1 time: 0.108597 Oct 04 14:35:31.368234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 426/878] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:31 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:32.087104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:32.088055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:32.095124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:32.095620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:32.096061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:32.096818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:32.097268 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:32.098023 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:32.394483 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:32.396169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:32.396876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:32.414300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f308346a-89f6-47f5-969a-747d32537ee3 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.333230 Oct 04 14:35:32.416523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 453/879] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:32 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:32.422125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:32.422966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:32.423628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:32.424570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:32.425197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:32.425792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:32.426078 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:32.428579 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:32.445474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:32.446105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:32.446891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:32.447985 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:32.449025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:32.449808 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:32.463316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:32.713207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:32.722628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-395a4bdb-8a91-4b39-b75e-0564d22eaa46 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1278 microversion: 2.1 time: 0.304698 Oct 04 14:35:32.723509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 454/880] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:32 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:32.759631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:32.771722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8bf7da33-ee98-4086-a990-fc5765151f71 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1691 microversion: 2.1 time: 0.397833 Oct 04 14:35:32.773483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 427/881] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:32 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1691 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:33.284182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-e6b10efa-ef34-4ea3-aa8b-4e3d68361e69 req-0dc07b07-9ece-4b71-a6c7-c4fc7d39f2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302", "name": "network-vif-deleted", "tag": "31660410-8845-41c4-b49c-b89043507bb3"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:33.302681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e6b10efa-ef34-4ea3-aa8b-4e3d68361e69 req-0dc07b07-9ece-4b71-a6c7-c4fc7d39f2a8 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.303492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e6b10efa-ef34-4ea3-aa8b-4e3d68361e69 req-0dc07b07-9ece-4b71-a6c7-c4fc7d39f2a8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.304106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-e6b10efa-ef34-4ea3-aa8b-4e3d68361e69 req-0dc07b07-9ece-4b71-a6c7-c4fc7d39f2a8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.320133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-e6b10efa-ef34-4ea3-aa8b-4e3d68361e69 req-0dc07b07-9ece-4b71-a6c7-c4fc7d39f2a8 service nova] Creating event network-vif-deleted:31660410-8845-41c4-b49c-b89043507bb3 for instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 on hv-cinder-86026 Oct 04 14:35:33.325810 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-e6b10efa-ef34-4ea3-aa8b-4e3d68361e69 req-0dc07b07-9ece-4b71-a6c7-c4fc7d39f2a8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178673 Oct 04 14:35:33.326750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 455/882] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:33.440785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:33.441470 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:33.448464 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.449207 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.449819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.451772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.458202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-512b8cf5-e9d1-46dd-b9ca-8e7f3d37444d req-45cd85db-c60b-412b-842f-d7ec6d8320a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e076e5d9-70c2-4624-b6b9-6e0b030d73e5", "tag": "0beda3fd-dcf6-460d-9272-d7d5984b6508"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:33.464814 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.465546 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.474272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-512b8cf5-e9d1-46dd-b9ca-8e7f3d37444d req-45cd85db-c60b-412b-842f-d7ec6d8320a4 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.474757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-512b8cf5-e9d1-46dd-b9ca-8e7f3d37444d req-45cd85db-c60b-412b-842f-d7ec6d8320a4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.475191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-512b8cf5-e9d1-46dd-b9ca-8e7f3d37444d req-45cd85db-c60b-412b-842f-d7ec6d8320a4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.498022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-512b8cf5-e9d1-46dd-b9ca-8e7f3d37444d req-45cd85db-c60b-412b-842f-d7ec6d8320a4 service nova] Creating event network-changed:0beda3fd-dcf6-460d-9272-d7d5984b6508 for instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 on hv-cinder-86026 Oct 04 14:35:33.511491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-512b8cf5-e9d1-46dd-b9ca-8e7f3d37444d req-45cd85db-c60b-412b-842f-d7ec6d8320a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057026 Oct 04 14:35:33.513439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 456/883] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:33.644363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:33.655387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8dbddb0d-eb41-4d3b-8f16-5b93de4d3eee tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1319 microversion: 2.1 time: 0.218031 Oct 04 14:35:33.656554 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 428/884] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:33 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:33.746412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:33.747136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:33.754242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.754730 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.755166 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.755905 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.756400 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.756823 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.798969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:33.800008 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:33.807672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.808249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.809116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.810680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.811233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.811669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.887038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:33.888512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:33.889562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:33.890395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:33.930963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:33.941521 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e92a9338-2b21-41c0-9721-a6328beb75d3 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.199346 Oct 04 14:35:33.951996 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 457/885] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:33 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:33.959321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:33.970477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-62253f5d-e0a0-4aab-ab1a-70dcb39fe2c7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1335 microversion: 2.1 time: 0.177572 Oct 04 14:35:33.971079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 429/886] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:33 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:34.681012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:34.681993 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:34.684863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:34.685750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=8 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:34.693915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:34.694414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:34.695140 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:34.695774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:34.696227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:34.696684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:34.863107 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:34.876088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d9f3c05a-c0af-48a4-a3c2-df765217c062 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1508 microversion: 2.1 time: 0.200662 Oct 04 14:35:34.876789 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 458/887] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:34 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:34.902055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b06632f-86e2-4ea6-aea9-6f476f366f5e", "device": "/dev/sdb"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:34.905769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:34.908478 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=8 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:34.914443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:34.914935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:34.915368 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:34.916076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:34.916560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:34.916988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:34.966736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:34.967484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:34.977621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:34.978116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:34.978559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:34.979374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:34.979839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:34.980455 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:35.158933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:35.167983 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3e34bc61-b33f-4b6c-91fc-4eb65cb694ea tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.205595 Oct 04 14:35:35.168625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 459/888] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:34 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:35.174860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:35.175501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:35.188775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:35.189305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:35.189692 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:35.190665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:35.191174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:35.191592 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:35.255669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:35.256869 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:35.257570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:35.258330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:35.309142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:35.317406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-24f2dbed-0f3f-4f39-9ada-55785b16fae7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 200 len: 1335 microversion: 2.1 time: 0.147142 Oct 04 14:35:35.318670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 460/889] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:35 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 1335 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:35.438323 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c715acaf-5cfe-4dbd-a45e-33370ed188c0 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "POST /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540299 Oct 04 14:35:35.444399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 430/890] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:35:34 2022] POST /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:36.209106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:36.210195 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:36.220853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:36.222038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:36.222540 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:36.223370 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:36.223891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:36.224548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:36.362622 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:36.364005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:36.371653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:36.372925 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:36.373639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:36.374586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:36.375184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:36.375716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:36.383627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:36.392585 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] HTTP exception thrown: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 could not be found. Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Request method failure captured: Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 HTTP/1.1 Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENd645BW0PdaWe-YwDoffCgwpYWCio58x6Ai1V3CQDWp9xhPbUjAW1BffH4YPXEQVQ_drSOgAgX41jji4KCaHWx4yCTkcysZ2k1XQjjdHZLHdsuNEsXAGreSCLKKPLJnooIoXNGtvB6_mJvjinDG11Hu96hUB2daSUFGkN6DasRMA8 Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:35:36.394695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec24f1b720bd42ebb37a36d65757aacd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 2b4c980bac3e444faa0e6f1a1d270cfa Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 could not be found. Oct 04 14:35:36.397810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302'} Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 could not be found. Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:35:36.400532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 could not be found. Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 could not be found. Oct 04 14:35:36.404270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:36.407341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Returning 404 to user: Instance 0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:35:36.407341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bc19de0c-ff4e-4ce6-a0e3-f3267007237e tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302" status: 404 len: 111 microversion: 2.1 time: 0.040630 Oct 04 14:35:36.407341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 431/891] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:36 2022] GET /compute/v2.1/servers/0b5b0a16-9c2c-4ad8-a41c-1c0459aa2302 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 14:35:36.407751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ed680861-cb25-43c3-a84d-6713c436ff57 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.201506 Oct 04 14:35:36.407751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 461/892] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:36 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:36.414952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fd926bb9-505f-4201-9562-7b244015bc7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '.version_select at 0x7f57186e0700>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:36.438408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fd926bb9-505f-4201-9562-7b244015bc7c tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-271316991" status: 202 len: 0 microversion: 2.1 time: 0.035771 Oct 04 14:35:36.439122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 432/893] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Oct 4 14:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-271316991 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:35:37.433129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:37.433763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:37.441052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:37.441539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:37.441973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:37.442678 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:37.443121 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:37.443539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:37.586539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:37.594707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8256b006-c8cb-44eb-bb09-5d40a64aa191 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.166743 Oct 04 14:35:37.595539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 462/894] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:37 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:38.421732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:38.424037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:38.431498 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:38.431992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:38.432460 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:38.433173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:38.433628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:38.434054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:38.515254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-80f26330-cc87-4c98-b7bf-5df3136c7641 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/action" status: 202 len: 0 microversion: 2.1 time: 0.099528 Oct 04 14:35:38.516291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 433/895] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:35:38 2022] POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:35:38.524833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:38.525607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:38.527844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:38.564963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:38.565550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:38.566090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:38.566925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:38.567715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:38.568393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:38.624905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:38.625734 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:38.634566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:38.635412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:38.637125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:38.638804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:38.639629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:38.640527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:38.816338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:38.827279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-045edf6f-e7be-4d2c-add3-cf0ea6f10e79 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1751 microversion: 2.1 time: 0.306464 Oct 04 14:35:38.828273 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 463/896] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:38 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1751 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:38.919066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:38.927778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7b0f3db9-5923-4e79-abb2-fe0b6811de66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.312361 Oct 04 14:35:38.928404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 434/897] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:38 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:39.429925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:39.430485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:39.437749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.438240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.438675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.439385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.439838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.440264 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.468015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:35:39.560283 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a9cc48f0-fa5d-4111-9df2-368b38203c44 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 204 len: 0 microversion: 2.1 time: 0.132799 Oct 04 14:35:39.565477 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 464/898] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:35:39 2022] DELETE /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:35:39.573996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:39.574845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:39.582645 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.583146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.583588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.584302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.584806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.585238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.729940 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:39.738344 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c28e3352-be11-4fff-9453-8faa44eac005 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1507 microversion: 2.1 time: 0.170685 Oct 04 14:35:39.738963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 435/899] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:39 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:39.863450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:39.864148 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:39.870550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.871051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.871479 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.873647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.874113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.874547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.956853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:39.958110 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:39.969930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.970819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.971625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:39.973028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:39.973895 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:39.974710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:40.065355 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:40.077571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7ecf9dc6-659e-4422-a0e3-57b9cb173180 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.218366 Oct 04 14:35:40.078385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 465/900] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:39 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:40.146167 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:40.155787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c52124ee-9971-4784-ac26-45bd1fa4ed03 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.203882 Oct 04 14:35:40.156404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 436/901] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:39 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:40.762175 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:40.762842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:40.769825 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:40.770313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:40.770753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:40.771470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:40.771927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:40.772385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:40.777205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:40.920438 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:40.929080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-23961c1c-b773-4e1d-8c5f-7577a8b83c73 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1507 microversion: 2.1 time: 0.170793 Oct 04 14:35:40.929708 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 466/902] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:40 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:41.103611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:41.104153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:41.112520 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:41.113026 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:41.113477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:41.114209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:41.114704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:41.115134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:41.178779 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:41.179428 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:41.186904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:41.187394 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:41.187827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:41.188567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:41.189017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:41.189439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:41.285679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:41.294794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f2add8e1-cda7-47ce-a5d8-d703995caf69 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.195320 Oct 04 14:35:41.295537 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 437/903] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:41 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:41.348984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:41.357111 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0839f8a7-409a-4309-9e41-0d8e94717a12 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.182129 Oct 04 14:35:41.357591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 467/904] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:41 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:41.958555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:41.959800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:41.970078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:41.970950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:41.971747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:41.973249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:41.973939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:41.974657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:42.162095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:42.171817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b53f9acb-af1f-434c-ab5d-7725b3c03de7 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1507 microversion: 2.1 time: 0.222028 Oct 04 14:35:42.173760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 438/905] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:41 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:42.319527 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:42.320057 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:42.326725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:42.327205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:42.327631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:42.328343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:42.328799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:42.329210 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:42.383081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:42.386593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:42.391114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:42.391716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:42.392226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:42.393001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:42.393458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:42.393881 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:42.498903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:42.516861 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0e19efb5-ba3a-4282-a4af-8a75866d209c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.200445 Oct 04 14:35:42.518063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 468/906] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:42 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:42.555175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:42.564641 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f4d2336f-f8d7-48d5-a458-bfde24f9ad0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.186887 Oct 04 14:35:42.565237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 439/907] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:42 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:43.196550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:43.197282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:43.205176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.205789 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.206281 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.207041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.207708 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.208183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.369035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:43.382809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-49390e2f-c920-4081-bf52-5a87c4201809 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1507 microversion: 2.1 time: 0.190426 Oct 04 14:35:43.383847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 469/908] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:43 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:43.558104 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:43.558830 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:43.567123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.567618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.568051 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.568946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.569405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.569825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.589568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:43.590282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:43.597058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.597897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.598332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.599038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.599484 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.599899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.762151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:43.771445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9a71153b-5161-413d-9ea3-30618bf6bf22 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.185714 Oct 04 14:35:43.772760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 470/909] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:43 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:43.823918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:43.841859 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cf39aceb-5ab2-4e95-81f4-c59e100e1fc1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.304961 Oct 04 14:35:43.842811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 440/910] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:43 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:43.898361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-b5e37a3c-1f3f-4fdf-9dfd-0f3851a5a90e req-79c7e566-f58c-4167-8ac1-b788aeefe588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd38da3-9e0e-426c-b4a2-9c582119f22f", "name": "network-vif-deleted", "tag": "fdd48946-1df6-48c0-871f-7f58d52dcaba"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:43.910196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-b5e37a3c-1f3f-4fdf-9dfd-0f3851a5a90e req-79c7e566-f58c-4167-8ac1-b788aeefe588 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:43.911068 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-b5e37a3c-1f3f-4fdf-9dfd-0f3851a5a90e req-79c7e566-f58c-4167-8ac1-b788aeefe588 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:43.911494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-b5e37a3c-1f3f-4fdf-9dfd-0f3851a5a90e req-79c7e566-f58c-4167-8ac1-b788aeefe588 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:43.924011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-b5e37a3c-1f3f-4fdf-9dfd-0f3851a5a90e req-79c7e566-f58c-4167-8ac1-b788aeefe588 service nova] Creating event network-vif-deleted:fdd48946-1df6-48c0-871f-7f58d52dcaba for instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f on hv-cinder-86026 Oct 04 14:35:43.929843 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-b5e37a3c-1f3f-4fdf-9dfd-0f3851a5a90e req-79c7e566-f58c-4167-8ac1-b788aeefe588 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 Oct 04 14:35:43.931129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 471/911] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:44.407778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:44.408437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:44.416813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.417542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.419219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.420934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.421361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.421861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.456271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.456485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.456926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.457379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid 0cd38da3-9e0e-426c-b4a2-9c582119f22f {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:44.508203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:44.517095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cf283e90-cd23-4b18-b7a9-344bd28e957a tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1311 microversion: 2.1 time: 0.113917 Oct 04 14:35:44.517578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 441/912] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:44 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:44.803361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:44.804155 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:44.811323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.811856 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.812336 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.813113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.813600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.814055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.867467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:44.868109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:44.875242 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.875734 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.876170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.877112 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:44.877589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:44.878149 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:44.995450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:45.005100 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0df36308-deb0-4451-b8e5-c0d1d645cdcb tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.206823 Oct 04 14:35:45.005816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 472/913] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:44 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:45.068655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:45.072178 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:45.078843 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-05765122-1d68-4c6a-94a9-a15e33a5a915 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.215556 Oct 04 14:35:45.079427 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 442/914] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:44 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:45.541291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:45.541913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:45.549376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:45.549870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:45.550307 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:45.551017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:45.551473 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:45.551896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:45.584743 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:45.585144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:45.585582 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:45.586033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid 0cd38da3-9e0e-426c-b4a2-9c582119f22f {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:45.638937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:45.647118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3fd0c176-77d9-4a37-8aa5-5c759f805eff tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1311 microversion: 2.1 time: 0.109680 Oct 04 14:35:45.647708 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 473/915] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:45 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:46.031134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:46.031793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:46.040172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.040704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.041151 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.041885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.042341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.042774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.104255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:46.105212 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:46.113500 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.113986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.114419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.115128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.115572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.115989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.191137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:46.199382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8fcc3633-6bac-4a22-9941-e631b02db2b7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.174021 Oct 04 14:35:46.200434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 443/916] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:46 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:46.283485 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:46.291927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7a30a901-1620-4673-b9cc-8bc7345aa95b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.192183 Oct 04 14:35:46.292539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 474/917] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:46 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:46.681504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:46.682133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:46.689398 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.689896 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.690334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.691076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.691530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.691953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.726835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:46.727318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:46.727759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:46.728209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid 0cd38da3-9e0e-426c-b4a2-9c582119f22f {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:46.773134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:46.782147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4f9a3cb1-5999-4e7e-99b1-aeb330ee9381 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 200 len: 1311 microversion: 2.1 time: 0.104562 Oct 04 14:35:46.782744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 444/918] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:46 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:47.222402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:47.223033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:47.229532 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.230017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.230456 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.231240 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.231693 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.232124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.316793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:47.317926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:47.326398 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.326635 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.326860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.327592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.328048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.328502 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.386770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:47.403510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-31e48a30-b574-428e-9678-0320b4378508 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.183845 Oct 04 14:35:47.416785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 475/919] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:47 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:47.551044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:47.564020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d1b1b6bd-256e-4e82-b738-bc8d8d2bf8cb tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.250973 Oct 04 14:35:47.577899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 445/920] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:47 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:47.650452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:47.650972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:47.660638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.662442 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.663103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.663873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.664488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.664952 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.692221 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d22051a4-18d8-49bb-9a05-b4d748eb854d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/ips" status: 200 len: 148 microversion: 2.1 time: 0.050377 Oct 04 14:35:47.693222 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 476/921] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:35:47 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/ips => generated 148 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:47.811488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:47.812101 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: 0cd38da3-9e0e-426c-b4a2-9c582119f22f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:47.818716 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.819216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.819657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.820412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.820874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.821305 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.839203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] HTTP exception thrown: Instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f could not be found. Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Request method failure captured: Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f HTTP/1.1 Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENd645BW0PdaWe-YwDoffCgwpYWCio58x6Ai1V3CQDWp9xhPbUjAW1BffH4YPXEQVQ_drSOgAgX41jji4KCaHWx4yCTkcysZ2k1XQjjdHZLHdsuNEsXAGreSCLKKPLJnooIoXNGtvB6_mJvjinDG11Hu96hUB2daSUFGkN6DasRMA8 Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:35:47.842321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec24f1b720bd42ebb37a36d65757aacd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 2b4c980bac3e444faa0e6f1a1d270cfa Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f could not be found. Oct 04 14:35:47.844360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '0cd38da3-9e0e-426c-b4a2-9c582119f22f'} Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f could not be found. Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:35:47.845270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f could not be found. Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f could not be found. Oct 04 14:35:47.846780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:47.848206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Returning 404 to user: Instance 0cd38da3-9e0e-426c-b4a2-9c582119f22f could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:35:47.848206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-105621c6-eed2-47a5-be61-dd09c0923220 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f" status: 404 len: 111 microversion: 2.1 time: 0.038014 Oct 04 14:35:47.848206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 446/922] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:47 2022] GET /compute/v2.1/servers/0cd38da3-9e0e-426c-b4a2-9c582119f22f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:35:47.854448 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:47.855340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:47.864011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.864574 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.865177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.866069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:47.866559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:47.867019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:47.896981 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:35:48.026915 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9da3d12a-63bc-4d0f-b67e-883de81564ce tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 204 len: 0 microversion: 2.1 time: 0.175996 Oct 04 14:35:48.027846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 477/923] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:35:47 2022] DELETE /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 14:35:48.042078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:48.042987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:48.051451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:48.052223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:48.053407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:48.054383 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:48.055072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:48.055778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:48.235699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:48.245846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3547e716-0c17-4147-853b-70f734030ea4 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.212912 Oct 04 14:35:48.247000 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 447/924] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:48 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:48.445401 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:48.448726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:48.460503 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:48.460995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:48.461427 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:48.462412 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:48.462864 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:48.463282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:48.596011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:48.596918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:48.604654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:48.605152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:48.605589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:48.607172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:48.607735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:48.608554 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:48.692548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:48.703558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-afceac68-36bc-45d4-bac6-879dcb386a51 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.266981 Oct 04 14:35:48.704145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 478/925] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:48 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:48.823335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:48.833348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-752e93c3-ded5-45bc-808c-fbf0b5f30521 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.242563 Oct 04 14:35:48.833852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 448/926] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:48 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:49.142346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21c615e5-c72c-4b36-beba-d3531a2df2e7"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:49.145064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:49.152902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.153705 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.154198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.154954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.155686 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.156113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.270405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:49.271030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:49.279005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.279499 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.279952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.280989 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.281462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.281905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.423869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:49.433679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dbddb288-307f-4286-a3a6-5d4e52d6599d tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.167698 Oct 04 14:35:49.434807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 449/927] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:49 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:49.729410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:49.730001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:49.737557 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.738040 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.738480 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.739166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.739614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.740027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.878328 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:49.886278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-00e3a966-8265-45bb-8869-d21749f16bf5 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.160576 Oct 04 14:35:49.886873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 450/928] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:49 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:49.891629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:49.892242 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:49.898333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.898820 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.899369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:49.899972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:49.900501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:49.900933 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:50.054001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:50.063611 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-be36f10f-0196-4022-a17a-279cd3bfc5ad tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.175647 Oct 04 14:35:50.064205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 451/929] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:49 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:50.461183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:50.461797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:50.469213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:50.469712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:50.470153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:50.470886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:50.471348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:50.471779 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:50.612979 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:50.621335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fcbe38d9-f561-4ae0-83a3-de4660308386 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.165865 Oct 04 14:35:50.622046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 452/930] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:50 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:50.909511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:50.910249 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:50.917217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:50.917700 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:50.918132 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:50.919672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:50.920127 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:50.920577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:51.075794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:51.084298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-50e098ec-d484-4ce8-b366-abfa35578520 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.178900 Oct 04 14:35:51.084938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 453/931] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:50 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:51.089619 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:51.090794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:51.097268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:51.097772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:51.098215 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:51.098943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:51.099402 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:51.099834 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:51.261712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:51.272327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-858e587f-49e8-46a9-aed9-64258603aed3 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.186293 Oct 04 14:35:51.273144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 454/932] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:51 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:51.647893 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:51.648536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:51.655963 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:51.656486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:51.656927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:51.657643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:51.658100 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:51.658527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:51.808058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:51.816372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bbb51964-6be3-4e0d-a75a-fbf4ba4425df tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.172291 Oct 04 14:35:51.816982 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 455/933] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:51 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:52.125098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:52.125810 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:52.132736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.133242 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.133685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:52.134411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.134871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.135302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:52.301900 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:52.311440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e9bf6f8f-329b-4576-9df9-3ebf57d53ad0 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.191394 Oct 04 14:35:52.312065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 456/934] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:52 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:52.318205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:52.318873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:52.327786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.328536 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.329052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:52.329801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.330277 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.330722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:52.553186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8360d244-eb45-44c4-be10-93225e0ff7b9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.414928 Oct 04 14:35:52.555509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 479/935] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:35:49 2022] POST /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 194 bytes in 3418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:52.558736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:52.569481 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-05b1e30e-c86d-412f-a9c3-a9d90299a26e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.256138 Oct 04 14:35:52.586864 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 457/936] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:52 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:52.688639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-d7e9d2e4-662d-45b4-a07c-ca18afe7d046 req-79bd5c5e-b998-42d4-a214-039e28238c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e076e5d9-70c2-4624-b6b9-6e0b030d73e5", "name": "network-vif-plugged", "status": "completed", "tag": "0beda3fd-dcf6-460d-9272-d7d5984b6508"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:52.700987 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d7e9d2e4-662d-45b4-a07c-ca18afe7d046 req-79bd5c5e-b998-42d4-a214-039e28238c83 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.701468 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d7e9d2e4-662d-45b4-a07c-ca18afe7d046 req-79bd5c5e-b998-42d4-a214-039e28238c83 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.701896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d7e9d2e4-662d-45b4-a07c-ca18afe7d046 req-79bd5c5e-b998-42d4-a214-039e28238c83 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:52.716676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-d7e9d2e4-662d-45b4-a07c-ca18afe7d046 req-79bd5c5e-b998-42d4-a214-039e28238c83 service nova] Creating event network-vif-plugged:0beda3fd-dcf6-460d-9272-d7d5984b6508 for instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 on hv-cinder-86026 Oct 04 14:35:52.722306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-d7e9d2e4-662d-45b4-a07c-ca18afe7d046 req-79bd5c5e-b998-42d4-a214-039e28238c83 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125445 Oct 04 14:35:52.722920 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 480/937] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:52.839901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:52.840621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:52.847181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.847691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.848107 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:52.849032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:52.849505 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:52.849935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:53.339747 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:53.341131 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:53.348976 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:53.349471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:53.350032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:53.350865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:53.351391 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:53.352135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:53.378613 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:53.543034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:53.566770 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e061c030-37ee-45a1-8150-9144b83eb1bb tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1523 microversion: 2.1 time: 0.730729 Oct 04 14:35:53.569041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 458/938] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:52 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1523 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:53.594084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:53.594934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:53.601935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:53.602731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:53.603181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:53.604556 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:53.605263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:53.606412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:53.618873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:53.629685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a5c3a47f-95b0-47a7-8d87-be14334f036d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.295218 Oct 04 14:35:53.632498 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 481/939] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:53 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:53.845063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:53.848962 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=100 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:53.855020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cd949e55-4cb4-469a-a243-9fdc38f36854 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.265570 Oct 04 14:35:53.855625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 459/940] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:53 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:54.001575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-fae39b30-b07f-469d-a976-4d2623489c27 req-4a32c8a7-3cbc-49ef-b818-f25a27f55f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79b4aa2-e418-4cb4-affc-2cbf5df8547c", "name": "network-vif-deleted", "tag": "b74df40d-d043-4af9-93a2-e99ed587df20"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:54.022112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-fae39b30-b07f-469d-a976-4d2623489c27 req-4a32c8a7-3cbc-49ef-b818-f25a27f55f66 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.022603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-fae39b30-b07f-469d-a976-4d2623489c27 req-4a32c8a7-3cbc-49ef-b818-f25a27f55f66 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.023035 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-fae39b30-b07f-469d-a976-4d2623489c27 req-4a32c8a7-3cbc-49ef-b818-f25a27f55f66 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.038811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-fae39b30-b07f-469d-a976-4d2623489c27 req-4a32c8a7-3cbc-49ef-b818-f25a27f55f66 service nova] Creating event network-vif-deleted:b74df40d-d043-4af9-93a2-e99ed587df20 for instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c on hv-cinder-86026 Oct 04 14:35:54.046224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-fae39b30-b07f-469d-a976-4d2623489c27 req-4a32c8a7-3cbc-49ef-b818-f25a27f55f66 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047874 Oct 04 14:35:54.047165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 482/941] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:54.592579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:54.593179 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:54.599957 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.600472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.600915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.601616 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.602072 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.602496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.636431 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.636943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.638308 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.638857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid e79b4aa2-e418-4cb4-affc-2cbf5df8547c {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:54.656889 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:54.657736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:54.666238 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.666747 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.667182 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.667885 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.669006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.670700 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.688076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:54.696063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-86c673f9-2c81-4f3d-9b9e-d8ac16e00907 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1312 microversion: 2.1 time: 0.108685 Oct 04 14:35:54.696685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 460/942] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:54 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:54.826087 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:54.834322 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-092bdcbd-94ea-4f21-aea5-0c3d4c20251f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1266 microversion: 2.1 time: 0.182759 Oct 04 14:35:54.834913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 483/943] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:54 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:54.881152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:54.881766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:54.888033 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.888566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.889006 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:54.889722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:54.890186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:54.890606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:55.052059 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:55.060876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-36126f75-c8d8-47c9-81f5-3af5d1994298 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.183619 Oct 04 14:35:55.061490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 461/944] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:54 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:55.719727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:55.720356 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:55.726883 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:55.727369 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:55.727804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:55.728571 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:55.729020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:55.729444 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:55.764635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:55.765112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:55.765558 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:55.766008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid e79b4aa2-e418-4cb4-affc-2cbf5df8547c {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:55.810070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:55.818757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3178ad9f-486b-48e0-a86d-3854db528900 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1312 microversion: 2.1 time: 0.103606 Oct 04 14:35:55.819353 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 484/945] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:55 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:55.858935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:55.859670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:55.867260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:55.867868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:55.868418 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:55.869259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:55.869814 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:55.870319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.025283 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:56.034117 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-543c99f5-d595-4545-b7b9-08ee8cd573e4 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1454 microversion: 2.1 time: 0.179780 Oct 04 14:35:56.034709 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 462/946] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:55 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:56.057516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:56.058170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:56.064994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.065481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.065916 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.066620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.067075 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.067503 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.085366 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:56.085981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:56.087866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:35:56.094045 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.094541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.094981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.095704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.096187 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.096640 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.209632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:56.218146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cbd9c943-f7ab-4a41-a8c6-35c6401880c9 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1454 microversion: 2.1 time: 0.164505 Oct 04 14:35:56.218745 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 485/947] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:56 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:56.256825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:56.268052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1a5854a1-2bcb-4e1a-b10b-4a0ad6b3d438 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.186513 Oct 04 14:35:56.272171 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 463/948] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:56 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:56.282031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:56.282921 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:56.290032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.290538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.291556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.292296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.292873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.293343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.453828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'services' on Instance uuid 2295516e-70cf-4d19-b2f9-ac828a22000f {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:56.548682 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ddfada4f-2d43-416f-b339-657041d3d015 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f/os-volume_attachments/9b06632f-86e2-4ea6-aea9-6f476f366f5e" status: 202 len: 0 microversion: 2.1 time: 0.271117 Oct 04 14:35:56.551478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 486/949] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:35:56 2022] DELETE /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f/os-volume_attachments/9b06632f-86e2-4ea6-aea9-6f476f366f5e => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:35:56.848268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:56.849617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:56.863494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.864354 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.865349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.866897 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.867679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.868836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.932688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:56.934026 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:56.934869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:56.935625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lazy-loading 'fault' on Instance uuid e79b4aa2-e418-4cb4-affc-2cbf5df8547c {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:57.015373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4c980bac3e444faa0e6f1a1d270cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24f1b720bd42ebb37a36d65757aacd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:57.024827 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-64fddd45-c9a1-4d4d-8cd2-eba00f2d9c51 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 200 len: 1312 microversion: 2.1 time: 0.183185 Oct 04 14:35:57.025713 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 464/950] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:56 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:57.073785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21c615e5-c72c-4b36-beba-d3531a2df2e7"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:57.077109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:57.083852 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.084471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.084982 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.085816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.086331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.086896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.188048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Invalid volume: volume 21c615e5-c72c-4b36-beba-d3531a2df2e7 is already attached to instances: 1cd13e9a-f9e0-49d8-b173-d65efded21ed Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: POST /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments HTTP/1.1 Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 74 Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:35:57.190062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {"volumeAttachment": {"volumeId": "21c615e5-c72c-4b36-beba-d3531a2df2e7"}} Oct 04 14:35:57.191752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Invalid volume: volume 21c615e5-c72c-4b36-beba-d3531a2df2e7 is already attached to instances: 1cd13e9a-f9e0-49d8-b173-d65efded21ed Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'server_id': '1cd13e9a-f9e0-49d8-b173-d65efded21ed', 'body': {'volumeAttachment': {'volumeId': '21c615e5-c72c-4b36-beba-d3531a2df2e7'}}} Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 21c615e5-c72c-4b36-beba-d3531a2df2e7 is already attached to instances: 1cd13e9a-f9e0-49d8-b173-d65efded21ed Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:57.192603 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 21c615e5-c72c-4b36-beba-d3531a2df2e7 is already attached to instances: 1cd13e9a-f9e0-49d8-b173-d65efded21ed Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:57.193860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 21c615e5-c72c-4b36-beba-d3531a2df2e7 is already attached to instances: 1cd13e9a-f9e0-49d8-b173-d65efded21ed Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 400 to user: Invalid volume: volume 21c615e5-c72c-4b36-beba-d3531a2df2e7 is already attached to instances: 1cd13e9a-f9e0-49d8-b173-d65efded21ed {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cab2b260-657e-4e88-96d8-79ec53fc6541 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123162 Oct 04 14:35:57.195136 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 487/951] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:35:57 2022] POST /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:35:57.267750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:57.268531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:57.276938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.278689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.279985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.281463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.282155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.284436 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.291826 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:57.292567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:57.305718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.308001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.311855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.312744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.313287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.313783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.410161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'services' on Instance uuid 1cd13e9a-f9e0-49d8-b173-d65efded21ed {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:35:57.521057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8396da5b-0c5f-4070-855a-5f3366382745 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments/21c615e5-c72c-4b36-beba-d3531a2df2e7" status: 202 len: 0 microversion: 2.1 time: 0.259073 Oct 04 14:35:57.521857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 465/952] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:35:57 2022] DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments/21c615e5-c72c-4b36-beba-d3531a2df2e7 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:35:57.531144 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:57.533883 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:57.540988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.541481 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.542128 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.542851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:57.543920 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:57.544636 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:57.579829 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a9e54072-e61c-47a9-9049-58599c0ef9cf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053044 Oct 04 14:35:57.580358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 466/953] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:57 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:35:57.582271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:57.597340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-456bd998-77cf-4f4a-af5c-cab7f87f43fc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.309191 Oct 04 14:35:57.598453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 488/954] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:57 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:58.048568 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:58.049870 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] [instance: e79b4aa2-e418-4cb4-affc-2cbf5df8547c] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:58.056657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.057158 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.057602 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.058327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.058831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.059271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.075584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] HTTP exception thrown: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c could not be found. Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Request method failure captured: Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c HTTP/1.1 Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENd645BW0PdaWe-YwDoffCgwpYWCio58x6Ai1V3CQDWp9xhPbUjAW1BffH4YPXEQVQ_drSOgAgX41jji4KCaHWx4yCTkcysZ2k1XQjjdHZLHdsuNEsXAGreSCLKKPLJnooIoXNGtvB6_mJvjinDG11Hu96hUB2daSUFGkN6DasRMA8 Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:35:58.077442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ec24f1b720bd42ebb37a36d65757aacd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ec24f1b720bd42ebb37a36d65757aacd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: ec24f1b720bd42ebb37a36d65757aacd Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381493964 Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 2b4c980bac3e444faa0e6f1a1d270cfa Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381493964-project Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c could not be found. Oct 04 14:35:58.079172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': 'e79b4aa2-e418-4cb4-affc-2cbf5df8547c'} Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c could not be found. Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:35:58.080226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c could not be found. Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c could not be found. Oct 04 14:35:58.081867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:35:58.083318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] Returning 404 to user: Instance e79b4aa2-e418-4cb4-affc-2cbf5df8547c could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:35:58.083318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8e8e2156-003c-481d-9714-b601b9e90980 tempest-ServerRescueNegativeTestJSON-1381493964 tempest-ServerRescueNegativeTestJSON-1381493964-project] 10.222.0.64 "GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c" status: 404 len: 111 microversion: 2.1 time: 0.034647 Oct 04 14:35:58.083318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 467/955] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:58 2022] GET /compute/v2.1/servers/e79b4aa2-e418-4cb4-affc-2cbf5df8547c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:35:58.426690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-cb1b53e0-80a4-4545-8d60-54c66ca976ff req-f3be75b5-07ff-46da-8f89-c0b012537954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e076e5d9-70c2-4624-b6b9-6e0b030d73e5", "tag": "0beda3fd-dcf6-460d-9272-d7d5984b6508"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:35:58.440362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cb1b53e0-80a4-4545-8d60-54c66ca976ff req-f3be75b5-07ff-46da-8f89-c0b012537954 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.440824 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cb1b53e0-80a4-4545-8d60-54c66ca976ff req-f3be75b5-07ff-46da-8f89-c0b012537954 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.441456 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cb1b53e0-80a4-4545-8d60-54c66ca976ff req-f3be75b5-07ff-46da-8f89-c0b012537954 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.454556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-cb1b53e0-80a4-4545-8d60-54c66ca976ff req-f3be75b5-07ff-46da-8f89-c0b012537954 service nova] Creating event network-changed:0beda3fd-dcf6-460d-9272-d7d5984b6508 for instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 on hv-cinder-86026 Oct 04 14:35:58.460677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-cb1b53e0-80a4-4545-8d60-54c66ca976ff req-f3be75b5-07ff-46da-8f89-c0b012537954 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037533 Oct 04 14:35:58.461279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 489/956] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:58.592912 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:58.595289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:58.602771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.603387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.604037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.604793 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.605247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.605767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.623351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:58.624593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:58.631459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.632336 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.633011 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.633960 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.634637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.635280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.647621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-54f5ca03-70f7-4cd2-b2bb-83cd818095c9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058871 Oct 04 14:35:58.648565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 468/957] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:58 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:58.843192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:58.844016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:58.851529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.852966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.853604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.854560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:58.856432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:58.857122 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:58.881442 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:58.890080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:35:58.894992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-17f27b9c-bb72-41b9-9ed4-63068b6b2a28 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.276360 Oct 04 14:35:58.896867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 490/958] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:58 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:35:58.991087 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1ab3ddf9-28a9-4576-90ce-91ed44755c49 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 204 len: 0 microversion: 2.1 time: 0.153219 Oct 04 14:35:58.991764 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 469/959] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:35:58 2022] DELETE /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:35:59.000352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:59.001300 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:59.007726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:59.008354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:59.008887 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:59.009665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:59.010180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:59.010806 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:59.162780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:35:59.173333 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7acc88e6-25a8-4817-8682-f52ced1151d4 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1560 microversion: 2.1 time: 0.177001 Oct 04 14:35:59.174093 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 491/960] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:58 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:35:59.662719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:59.665800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:59.673987 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:59.674474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:59.674932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:59.675850 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:59.676347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:59.677093 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:59.723849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-44dab8d7-261d-4179-aba8-72cf4490bc7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065585 Oct 04 14:35:59.724828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 470/961] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:35:59 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:35:59.921570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:35:59.922308 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:35:59.930538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:59.931125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:59.931648 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:35:59.932457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:35:59.932838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:35:59.934194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:00.120836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:00.130717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-eeaef52b-0b55-49e8-8a83-ff5c7f562136 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.213719 Oct 04 14:36:00.131327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 492/962] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:35:59 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:00.197285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:00.197909 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:00.205034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:00.205708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:00.206251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:00.207076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:00.207538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:00.207965 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:00.407223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:00.416772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1a098910-5a71-494d-9f75-518967f75130 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1514 microversion: 2.1 time: 0.223425 Oct 04 14:36:00.417369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 471/963] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:00 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:00.737759 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:00.740242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:00.747230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:00.747880 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:00.748481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:00.749411 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:00.749997 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:00.750529 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:00.795812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-acd379b3-b4f6-4ea6-812d-f4b1521c56a2 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062348 Oct 04 14:36:00.797431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 493/964] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:00 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:01.157150 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:01.157966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:01.164765 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:01.165265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:01.165714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:01.166443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:01.166905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:01.167338 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:01.351655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:01.362682 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f3fdc659-d611-4fad-aa73-e8f629f041f1 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.210943 Oct 04 14:36:01.363405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 472/965] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:01 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:01.441258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:01.441901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:01.448991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:01.449619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:01.450060 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:01.450781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:01.451411 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:01.451988 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:01.727113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:01.738248 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-706428be-e106-462b-b81e-42b7f22af243 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1514 microversion: 2.1 time: 0.300842 Oct 04 14:36:01.739008 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 494/966] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:01 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1514 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:01.810148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:01.812933 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:01.822775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:01.823633 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:01.824508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:01.825530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:01.826076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:01.826720 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:01.870682 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e7102e0c-fe8b-43a4-9635-a54915a18e5a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065423 Oct 04 14:36:01.872189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 473/967] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:01 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:02.388266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:02.389236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:02.400879 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.403097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.403758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.404389 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.404848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.406243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.570548 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-5c629c2d-9bba-4d62-8a0b-05cf50177ea8 req-cc4deaa9-746c-4a32-9e68-0cb501746b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2295516e-70cf-4d19-b2f9-ac828a22000f", "name": "network-vif-deleted", "tag": "1d559ed8-89f8-4e6f-a8eb-f50f0e9e1804"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:02.611780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5c629c2d-9bba-4d62-8a0b-05cf50177ea8 req-cc4deaa9-746c-4a32-9e68-0cb501746b5a service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.615595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5c629c2d-9bba-4d62-8a0b-05cf50177ea8 req-cc4deaa9-746c-4a32-9e68-0cb501746b5a service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.616349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5c629c2d-9bba-4d62-8a0b-05cf50177ea8 req-cc4deaa9-746c-4a32-9e68-0cb501746b5a service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.640767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:02.643799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-5c629c2d-9bba-4d62-8a0b-05cf50177ea8 req-cc4deaa9-746c-4a32-9e68-0cb501746b5a service nova] Creating event network-vif-deleted:1d559ed8-89f8-4e6f-a8eb-f50f0e9e1804 for instance 2295516e-70cf-4d19-b2f9-ac828a22000f on hv-cinder-86026 Oct 04 14:36:02.656410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-5c629c2d-9bba-4d62-8a0b-05cf50177ea8 req-cc4deaa9-746c-4a32-9e68-0cb501746b5a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089885 Oct 04 14:36:02.658023 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 474/968] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:02.728913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:02.742340 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e57f8499-3585-4cc8-ba22-ae5e1b5b3e21 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.358839 Oct 04 14:36:02.743762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 495/969] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:02 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:02.765370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:02.766196 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:02.774898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.775495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.776005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.776824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.778115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.779607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.831345 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.832267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.833148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.834039 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'fault' on Instance uuid 2295516e-70cf-4d19-b2f9-ac828a22000f {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:02.888428 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:02.894969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:02.907706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.908208 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.911365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.912128 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:02.912630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:02.913068 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:02.953361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:02.992993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-51db6d52-7d15-4a0f-8232-f2be3de2ebb6 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1309 microversion: 2.1 time: 0.232934 Oct 04 14:36:02.999417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 475/970] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:02 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1309 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:03.010620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b9e4cc74-f898-4490-9b3d-d135c546b756 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129607 Oct 04 14:36:03.012441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 496/971] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:02 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:36:03.115886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:03.116580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:03.127492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.128196 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.129385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.130743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.131605 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.132540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.170319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:36:03.269520 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d07ed397-d56e-428f-93a4-c28457ae5ebd tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 204 len: 0 microversion: 2.1 time: 0.160373 Oct 04 14:36:03.270330 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 476/972] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:36:03 2022] DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:36:03.285556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:03.286753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:03.298066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.298890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.299533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.300653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.301374 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.301882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.464847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:03.475849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a0cc7ec8-2c24-43e4-b577-5c5cefd0f996 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1679 microversion: 2.1 time: 0.198974 Oct 04 14:36:03.476486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 497/973] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:03 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:03.664863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:03.665930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:03.677093 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.678382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.679377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.680957 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.681807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.682753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.712358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ed798245-d9df-43fd-9773-b7ac95d655fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/ips" status: 200 len: 152 microversion: 2.20 time: 0.055771 Oct 04 14:36:03.712950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 477/974] 10.222.0.64 () {60 vars in 1289 bytes} [Tue Oct 4 14:36:03 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:36:03.767901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:03.769036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:03.776567 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.777906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.778777 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.779918 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:03.780689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:03.781122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:03.785786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:03.998020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:04.019690 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:04.020346 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:04.029581 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:04.030086 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:04.032220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-596d63db-46d0-438b-9965-5e380041c8fe tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1756 microversion: 2.1 time: 0.268526 Oct 04 14:36:04.033763 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:04.034545 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:04.035027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:04.035466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:04.039862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 498/975] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:03 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1756 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:04.087184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:04.088528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:04.088528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:04.088780 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'fault' on Instance uuid 2295516e-70cf-4d19-b2f9-ac828a22000f {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:04.162003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:04.171773 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cb3c85b1-19c8-42ad-b31f-c0234b2af867 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1309 microversion: 2.1 time: 0.155943 Oct 04 14:36:04.172653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 478/976] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:04 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:36:04.503069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:04.503069 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:04.507807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:04.508290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:04.509014 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:04.509731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:04.510188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:04.510614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:04.689669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:04.698143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3ed8032b-1dfe-4d93-bb62-3fc414babc3d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1679 microversion: 2.1 time: 0.202484 Oct 04 14:36:04.698731 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 499/977] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:04 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:05.057974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:05.059562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:05.066135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.066629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.067063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.067782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.068241 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.068698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.208639 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:05.209867 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:05.223251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.225260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.226055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.227338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.228168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.228967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.274050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:05.281752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.282245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.282680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.283138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lazy-loading 'fault' on Instance uuid 2295516e-70cf-4d19-b2f9-ac828a22000f {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:05.283748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5b39bebb-a334-4dc6-a0c5-382b5e040333 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1759 microversion: 2.1 time: 0.230379 Oct 04 14:36:05.284394 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 479/978] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:05 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1759 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:05.361402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec52681fc41477e92786ad61aa96a76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742e9ad0995f4f96bcc1f75f5689a590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:05.371028 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-26fdc72c-ed06-4edd-9f05-416fead9fb37 tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 200 len: 1309 microversion: 2.1 time: 0.176975 Oct 04 14:36:05.372237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 500/979] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:05 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:05.733504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:05.734253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:05.740742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.741293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.741785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.742528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:05.742988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:05.743419 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:05.907763 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:05.920628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-84b32858-7603-4f85-b502-3c44082f1a98 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1679 microversion: 2.1 time: 0.191810 Oct 04 14:36:05.921223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 480/980] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:05 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:36:06.395268 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:06.395914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] [instance: 2295516e-70cf-4d19-b2f9-ac828a22000f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:06.403756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.404253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.404722 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.405707 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.406160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.406593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.420009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:06.421584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:06.422151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] HTTP exception thrown: Instance 2295516e-70cf-4d19-b2f9-ac828a22000f could not be found. Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Request method failure captured: Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f HTTP/1.1 Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPERPhPBEjLwrW--eTOguc0EBcTF5Mz_Wl9hBLKs720aPUdE9r-CF6TS3DaY4GLv42W21F8XtkK1Xwg2DCjkFsTHW8j8qTIRm3l1BrTFx2CuUmDfbLQ1_MbBoRhhtcheeRh8YIMPK8c4xzi1voQv4SMi14ZHCwmkBRtQQPBfzhP47wno Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 742e9ad0995f4f96bcc1f75f5689a590 Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesSnapshotTestJSON-441376065 Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:36:06.423854 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/742e9ad0995f4f96bcc1f75f5689a590"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_742e9ad0995f4f96bcc1f75f5689a590", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/742e9ad0995f4f96bcc1f75f5689a590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/742e9ad0995f4f96bcc1f75f5689a590"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesSnapshotTestJSON-441376065 Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 742e9ad0995f4f96bcc1f75f5689a590 Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-441376065 Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesSnapshotTestJSON-441376065-project Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 6ec52681fc41477e92786ad61aa96a76 Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesSnapshotTestJSON-441376065-project Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 2295516e-70cf-4d19-b2f9-ac828a22000f could not be found. Oct 04 14:36:06.425549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '2295516e-70cf-4d19-b2f9-ac828a22000f'} Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2295516e-70cf-4d19-b2f9-ac828a22000f could not be found. Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:36:06.426472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2295516e-70cf-4d19-b2f9-ac828a22000f could not be found. Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2295516e-70cf-4d19-b2f9-ac828a22000f could not be found. Oct 04 14:36:06.427839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:06.429893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] Returning 404 to user: Instance 2295516e-70cf-4d19-b2f9-ac828a22000f could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:36:06.430749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-dddeba5a-6cd9-4671-8318-504ea103c2df tempest-VolumesSnapshotTestJSON-441376065 tempest-VolumesSnapshotTestJSON-441376065-project] 10.222.0.64 "GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f" status: 404 len: 111 microversion: 2.1 time: 0.039479 Oct 04 14:36:06.435902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 501/981] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:06 2022] GET /compute/v2.1/servers/2295516e-70cf-4d19-b2f9-ac828a22000f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:36:06.436156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.436156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.436156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.436156 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.436538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.436538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.491318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lazy-loading 'flavor' on Instance uuid 35bb7e73-d6ea-4441-8b64-19affd0804f6 {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:06.749872 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-62469973-e0e1-4961-9c91-af2859a53a67 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/action" status: 202 len: 0 microversion: 2.20 time: 0.333257 Oct 04 14:36:06.750702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 481/982] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Oct 4 14:36:06 2022] POST /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 14:36:06.762962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:06.764583 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:06.776635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.778591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.779378 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.781757 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.782884 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.783785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.951323 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:06.952732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:06.962412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.963393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.964003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.965345 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:06.966161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:06.966821 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:06.995501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:07.012800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:07.016279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:07.018799 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1560fe4f-759a-46ab-afbe-a8614d806d2f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.263130 Oct 04 14:36:07.019820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 502/983] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:06 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:07.076339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:07.084513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d3c48255-9b45-48d5-b0b7-bc6b07926f60 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1612 microversion: 2.1 time: 0.140815 Oct 04 14:36:07.085103 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 482/984] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:06 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1612 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:07.215595 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-d4a095e9-8441-4d82-9369-77f48005b12e req-a7cda580-c2fc-4186-a5c0-94ddf45354cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd13e9a-f9e0-49d8-b173-d65efded21ed", "name": "network-vif-deleted", "tag": "7a4d66ba-4ece-415d-8b95-8f071ff501b9"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:07.233147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d4a095e9-8441-4d82-9369-77f48005b12e req-a7cda580-c2fc-4186-a5c0-94ddf45354cd service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:07.233549 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d4a095e9-8441-4d82-9369-77f48005b12e req-a7cda580-c2fc-4186-a5c0-94ddf45354cd service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:07.234219 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d4a095e9-8441-4d82-9369-77f48005b12e req-a7cda580-c2fc-4186-a5c0-94ddf45354cd service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:07.249423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-d4a095e9-8441-4d82-9369-77f48005b12e req-a7cda580-c2fc-4186-a5c0-94ddf45354cd service nova] Creating event network-vif-deleted:7a4d66ba-4ece-415d-8b95-8f071ff501b9 for instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed on hv-cinder-86026 Oct 04 14:36:07.255507 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-d4a095e9-8441-4d82-9369-77f48005b12e req-a7cda580-c2fc-4186-a5c0-94ddf45354cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045674 Oct 04 14:36:07.260660 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 503/985] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:08.055096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:08.057248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:08.069252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:08.070222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:08.070647 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:08.071942 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:08.072416 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:08.072944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:08.116064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:08.122103 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:08.140298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:08.143449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:08.144590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:08.145505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:08.146718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:08.147744 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:08.149611 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:08.239364 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:08.240242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:08.241309 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:08.242280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'fault' on Instance uuid 1cd13e9a-f9e0-49d8-b173-d65efded21ed {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:08.297187 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:08.307577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:08.309975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:08.311500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fc98e369-4702-4d25-9275-1e4d7ddbc4fa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.267749 Oct 04 14:36:08.316559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 483/986] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:08 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:08.339352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:08.349262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-232cc970-b737-4517-bfe3-70584cabfb57 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 200 len: 1331 microversion: 2.1 time: 0.243348 Oct 04 14:36:08.349904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 504/987] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:08 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 1331 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:09.340269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:09.340931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:09.348011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:09.348530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:09.348971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:09.349691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:09.350135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:09.350555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:09.373336 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:09.373955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:09.380760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:09.381250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:09.381694 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:09.382404 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:09.382855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:09.383279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:09.398668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed HTTP/1.1 Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:36:09.400343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:36:09.401742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '1cd13e9a-f9e0-49d8-b173-d65efded21ed'} Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:36:09.402588 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:36:09.404095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:36:09.405764 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:36:09.405764 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4c8e7309-5fc9-4b0d-abc7-e7f99f7d9814 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 404 len: 111 microversion: 2.1 time: 0.033092 Oct 04 14:36:09.405764 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 505/988] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:09 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 14:36:09.411208 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1168ae9c-a4bd-431c-9774-6a8f9914f2ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '.version_select at 0x7f571bfcf5e0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:09.433280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1168ae9c-a4bd-431c-9774-6a8f9914f2ad tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566406842" status: 202 len: 0 microversion: 2.1 time: 0.025580 Oct 04 14:36:09.435000 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 506/989] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Oct 4 14:36:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566406842 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:36:09.500961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:09.509965 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:09.511949 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:09.513233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-23792c0c-89a0-49ed-ab19-5a8dd036f0a5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.177502 Oct 04 14:36:09.513805 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 484/990] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:09 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:10.382239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-77873f61-0d74-47be-85a2-dab280c69f32 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: .version_select at 0x7f571bfef1f0>, body: {"keypair": {"name": "tempest-keypair-1502087991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxpO2r0HZ1WzPzi/2Vr0eQfhtIlt1ntSL19IDgqmlqvO+S7JSeCVwy+vdM6BW+L91s5oHLcj4JQdzGmC0wTXT3IFKFRhufdIidi+mxz6kN9W3nA768JzZsyjDBztfjOGQ=="}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:10.401732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-77873f61-0d74-47be-85a2-dab280c69f32 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:36:10.407383 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-77873f61-0d74-47be-85a2-dab280c69f32 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:36:10.435404 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-77873f61-0d74-47be-85a2-dab280c69f32 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057617 Oct 04 14:36:10.436025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 507/991] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:36:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:10.539853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:10.540724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:10.549772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:10.550607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:10.551376 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:10.552724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:10.553586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:10.555927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:10.755335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:10.765589 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:10.767057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:10.768264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-992186dd-e189-4ddf-be58-4a381edbf7f5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.232548 Oct 04 14:36:10.768858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 485/992] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:10 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:11.800774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:11.801967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:11.813171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:11.813675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:11.814126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:11.814858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:11.815323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:11.815760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:12.047706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:12.057254 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:12.058765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:12.060229 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c46db178-eb07-4540-bc05-4c30158c20d8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.268457 Oct 04 14:36:12.061074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 508/993] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:11 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:12.140347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2027740949", "imageRef": "ccf01c3a-fd84-479e-a64c-a1df8be0a94d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e89e862-e669-4987-af44-eb18dbc3b78d"}], "security_groups": [{"name": "tempest-securitygroup--937367692"}], "key_name": "tempest-keypair-1502087991", "user_data": "}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:12.252623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] validate_networks() for [('3e89e862-e669-4987-af44-eb18dbc3b78d', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:36:12.741038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:36:12.741747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:36:12.742558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:36:12.743278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:36:12.743980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:36:12.756242 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:12.757067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:12.757774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:12.759399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:12.759889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:12.760343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:12.784824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:36:12.790455 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Getting quotas for user 54b3856eb61a487dab21d8ffa345701c and project 1e5731dbee8946a281caefaeb02bd7ff. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:36:12.806336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:36:12.809124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ccf01c3a-fd84-479e-a64c-a1df8be0a94d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:36:12.866918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dcdf3db8-b310-450a-bd67-66462830ae15 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.730886 Oct 04 14:36:12.867603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 486/994] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:36:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:36:12.883289 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-558638c5-7361-442b-9f9b-2086a942262b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:12.884287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-558638c5-7361-442b-9f9b-2086a942262b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:12.978787 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-558638c5-7361-442b-9f9b-2086a942262b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:12.988448 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-558638c5-7361-442b-9f9b-2086a942262b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1242 microversion: 2.1 time: 0.112311 Oct 04 14:36:12.989219 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 509/995] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:12 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:13.089497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:13.090509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:13.101885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:13.102782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:13.103584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:13.105388 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:13.106251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:13.107269 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:13.308777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:13.318971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:13.321025 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:13.322284 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6cdf720b-af04-4baa-8573-f4f89a5d8d48 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.238868 Oct 04 14:36:13.323100 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 487/996] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:13 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:14.013168 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:14.013877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:14.021539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:14.022086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:14.022523 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:14.023234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:14.023690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:14.024116 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:14.101508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:14.111849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-142b6329-4824-4770-95c9-d461030478c7 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1246 microversion: 2.1 time: 0.102837 Oct 04 14:36:14.112749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 510/997] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:14 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:14.350229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:14.350851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:14.358831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:14.359333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:14.359778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:14.360614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:14.361073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:14.361496 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:14.366719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:14.538550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:14.550046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:14.551860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:14.553219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9dca8798-658d-4cb8-ae5c-88996cda8a90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.206952 Oct 04 14:36:14.553837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 488/998] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:14 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:15.138630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:15.140012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:15.146296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:15.147063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:15.147685 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:15.148397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:15.148849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:15.150081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:15.229172 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:15.242362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2f9e8ffb-8e5b-4068-9a8a-e616df27b177 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1302 microversion: 2.1 time: 0.107221 Oct 04 14:36:15.244085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 511/999] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:15 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:15.583874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:15.584564 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:15.595394 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:15.597217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:15.597654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:15.598848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:15.598848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:15.599237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:15.801233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:15.811649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:15.813526 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:15.815015 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-801a7d0d-c468-4cbe-8774-5107f25246d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.235266 Oct 04 14:36:15.829203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 489/1000] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:15 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:16.281298 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:16.282038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:16.295315 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:16.296117 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:16.296556 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:16.297425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:16.298042 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:16.298689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:16.476740 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:16.489245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b2adfc9b-9ae7-43b6-8c67-f131b8deb30a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.215278 Oct 04 14:36:16.490516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 512/1001] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:16 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:16.845627 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:16.846327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:16.853285 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:16.853848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:16.854291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:16.855083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:16.855543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:16.855975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:17.064075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:17.076301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:17.078125 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:17.080459 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-541df1b6-e193-4698-98b6-17ca2fed6bac tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.238493 Oct 04 14:36:17.081415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 490/1002] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:16 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:17.188844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-cd70309e-200b-4eaa-aa41-90790a9232a6 req-d40a7bb5-cb4f-4e67-bbd8-e5d2a4f8144e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a960e16e-2d9b-4ad0-95c8-d1b951f4a29f", "tag": "c36c3311-21de-407e-a97a-632316d80eb7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:17.201539 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cd70309e-200b-4eaa-aa41-90790a9232a6 req-d40a7bb5-cb4f-4e67-bbd8-e5d2a4f8144e service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:17.202144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cd70309e-200b-4eaa-aa41-90790a9232a6 req-d40a7bb5-cb4f-4e67-bbd8-e5d2a4f8144e service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:17.202975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cd70309e-200b-4eaa-aa41-90790a9232a6 req-d40a7bb5-cb4f-4e67-bbd8-e5d2a4f8144e service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:17.225169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-cd70309e-200b-4eaa-aa41-90790a9232a6 req-d40a7bb5-cb4f-4e67-bbd8-e5d2a4f8144e service nova] Creating event network-changed:c36c3311-21de-407e-a97a-632316d80eb7 for instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f on hv-cinder-86026 Oct 04 14:36:17.234655 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-cd70309e-200b-4eaa-aa41-90790a9232a6 req-d40a7bb5-cb4f-4e67-bbd8-e5d2a4f8144e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049737 Oct 04 14:36:17.235621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 513/1003] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:17.514402 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:17.515023 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:17.521186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:17.521676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:17.522318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:17.523139 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:17.523639 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:17.524034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:17.760718 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:17.774487 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a08661ce-63df-4d16-97b7-581e7e4510fb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.264830 Oct 04 14:36:17.775575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 491/1004] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:17 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:18.109185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:18.109773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:18.116253 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:18.116763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:18.117197 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:18.117902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:18.118348 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:18.118770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:18.188729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:18.189313 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:18.195796 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:18.196287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:18.196753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:18.197702 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:18.198205 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:18.199471 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:18.227585 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2dbdb8bd-f1b0-4d52-82a0-2354cdfc89b4 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/ips" status: 200 len: 145 microversion: 2.1 time: 0.043060 Oct 04 14:36:18.228197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 492/1005] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:36:18 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:18.263791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:18.273800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:18.275290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:18.277380 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-efbf920d-754f-4a7b-9e96-be6e030b4db6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.173302 Oct 04 14:36:18.278945 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 514/1006] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:18 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:18.805135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:18.805730 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:18.812512 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:18.812993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:18.813445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:18.814118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:18.814595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:18.815011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:18.963067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:18.971354 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-19dfb09e-aebf-4fed-9ffa-bbb7a0548c56 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.170015 Oct 04 14:36:18.971941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 493/1007] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:18 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:19.305773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:19.306419 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:19.314501 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:19.314857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:19.315371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:19.316149 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:19.316630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:19.317051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:19.468607 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:19.477112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:19.478599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:19.480445 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-665dc40a-365e-4bf6-9126-8804b0b49465 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.178866 Oct 04 14:36:19.481032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 515/1008] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:19 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:19.994998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:19.996227 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:20.002890 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:20.003380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:20.003820 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:20.004712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:20.005123 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:20.005845 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:20.151134 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:20.161273 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fcafd877-b1c0-4bb8-8c9a-7341b0ab9c7b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.170590 Oct 04 14:36:20.162137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 494/1009] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:19 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:20.508091 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:20.508752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:20.516469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:20.516964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:20.517403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:20.518122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:20.518575 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:20.519005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:20.683489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:20.692458 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:20.693899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:20.695073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b3cb3e22-157d-4e12-9294-3a4a1a13ff53 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.192149 Oct 04 14:36:20.695633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 516/1010] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:20 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:21.188558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:21.189857 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:21.203712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:21.204624 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:21.205226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:21.206023 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:21.206603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:21.207186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:21.361282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:21.371116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-df2fd991-eef1-4ef9-af84-cf3d7eb6a758 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.190272 Oct 04 14:36:21.371683 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 495/1011] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:21 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:21.721648 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:21.722853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:21.730339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:21.731203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:21.731829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:21.732742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:21.733828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:21.734421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:21.749874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60338fd1-2276-47fa-8d89-02af6a32c892"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:21.752955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:21.755305 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:21.763398 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:21.764165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:21.764848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:21.765782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:21.766245 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:21.766844 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:21.921284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:21.932230 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:21.935185 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:21.936568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-11880395-3c66-4e28-9055-93cc76bedcbf tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.219196 Oct 04 14:36:21.937947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 517/1012] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:21 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:22.124065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dfd1859e-0a93-4ee2-bc44-bf6044e9bcdd tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378728 Oct 04 14:36:22.124761 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 496/1013] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:36:21 2022] POST /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:22.405302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:22.406061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:22.414533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:22.415360 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:22.416219 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:22.417834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:22.418911 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:22.420282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:22.610294 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:22.619372 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f0826c29-8937-4dbf-b180-1f7e19edcb33 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.222093 Oct 04 14:36:22.619956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 518/1014] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:22 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:36:22.962753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:22.963547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:22.967318 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:22.968137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=6 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:22.975035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:22.975529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:22.975970 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:22.976714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:22.977172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:22.977597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:23.117019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:23.125980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:23.127452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:23.128685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-22f53e18-e121-4e81-b9ab-51e7e595abcb tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.170349 Oct 04 14:36:23.129263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 497/1015] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:22 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:23.642127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:23.642742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:23.645544 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=6 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:23.651466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:23.652932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:23.653489 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:23.654472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:23.655258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:23.655828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:23.805581 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:23.809882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:23.816145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e420fd49-e8ed-471c-aa67-31b0807974c0 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.177783 Oct 04 14:36:23.816842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 519/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:23 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:24.156676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:24.157617 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:24.165726 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:24.166254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:24.166693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:24.168584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:24.169078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:24.169509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:24.318406 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:24.327587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:24.329077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:24.330264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9aec0c88-2572-4db0-b546-65f6f512c5d4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.178602 Oct 04 14:36:24.330854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 498/1017] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:24 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:24.859000 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:24.859864 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:24.868862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:24.869359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:24.869801 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:24.871093 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:24.871597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:24.872051 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:25.079142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:25.088457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8896f2a4-d143-4163-8854-d5cf09d622bb tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.246698 Oct 04 14:36:25.090228 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 520/1018] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:24 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:25.356263 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:25.357795 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:25.365927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:25.366792 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:25.367437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:25.368233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:25.369462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:25.369967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:25.462359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-cfa5701d-1499-41aa-b7ed-722273abb03f req-15fcbcc7-888e-4d80-a689-6b5defb58561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a960e16e-2d9b-4ad0-95c8-d1b951f4a29f", "name": "network-vif-plugged", "status": "completed", "tag": "c36c3311-21de-407e-a97a-632316d80eb7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:25.478943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cfa5701d-1499-41aa-b7ed-722273abb03f req-15fcbcc7-888e-4d80-a689-6b5defb58561 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:25.479160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cfa5701d-1499-41aa-b7ed-722273abb03f req-15fcbcc7-888e-4d80-a689-6b5defb58561 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:25.480591 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-cfa5701d-1499-41aa-b7ed-722273abb03f req-15fcbcc7-888e-4d80-a689-6b5defb58561 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:25.505276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-cfa5701d-1499-41aa-b7ed-722273abb03f req-15fcbcc7-888e-4d80-a689-6b5defb58561 service nova] Creating event network-vif-plugged:c36c3311-21de-407e-a97a-632316d80eb7 for instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f on hv-cinder-86026 Oct 04 14:36:25.513106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-cfa5701d-1499-41aa-b7ed-722273abb03f req-15fcbcc7-888e-4d80-a689-6b5defb58561 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059497 Oct 04 14:36:25.514439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 521/1019] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:25.562577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:25.579902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:25.581453 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:25.591085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f350c7ab-0412-4a6b-a8d4-119dcebbadb7 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.231054 Oct 04 14:36:25.592019 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 499/1020] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:25 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:26.116835 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:26.117608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:26.125965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:26.126899 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:26.127342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:26.128154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:26.128717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:26.129210 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:26.306561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:26.317164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-034ff840-f7c3-4734-86a1-9bc68988be0c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1367 microversion: 2.1 time: 0.208547 Oct 04 14:36:26.318279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 522/1021] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:26 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:26.619443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:26.621631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:26.629656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:26.630311 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:26.630576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:26.631525 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:26.632229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:26.632852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:26.792030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:26.805841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:26.809451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:26.811449 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ef3fe55a-fb67-4b46-8f5f-877476371b9e tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.195691 Oct 04 14:36:26.812339 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 500/1022] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:26 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:27.342474 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:27.343206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:27.350758 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:27.351236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:27.351956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:27.352839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:27.353299 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:27.353903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:27.543572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:27.552738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-950c3f5c-633e-457b-ae0c-ccb4034f7e36 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1557 microversion: 2.1 time: 0.215463 Oct 04 14:36:27.553332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 523/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:27 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:27.583497 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:27.584001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:27.591553 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:27.592129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:27.592606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:27.593326 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:27.593805 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:27.594437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:27.713003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2e854125-5e82-4b6a-b977-eb2fc0054d6b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130632 Oct 04 14:36:27.717096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 501/1024] 10.222.0.64 () {58 vars in 1275 bytes} [Tue Oct 4 14:36:27 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:27.852000 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:27.853304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:27.862627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:27.864213 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:27.864766 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:27.865640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:27.866217 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:27.866716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:28.031207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:28.046965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:28.048729 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:28.050064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2ccd6f6c-f8ae-4601-a9ba-ca9a4a76ec98 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.206059 Oct 04 14:36:28.060578 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 524/1025] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:27 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:29.086292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:29.087926 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:29.108791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:29.109417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:29.110075 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:29.111043 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:29.111511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:29.112103 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:29.386696 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:29.406664 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:29.410053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:29.412561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-37179b9b-6ee9-4420-810e-0070b6f50f88 req-bc31b8d0-0da0-45b2-9a02-1791d80e5b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a960e16e-2d9b-4ad0-95c8-d1b951f4a29f", "tag": "c36c3311-21de-407e-a97a-632316d80eb7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:29.417254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-37c9e942-70d2-4d34-bf9d-3210b196d98f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1745 microversion: 2.20 time: 0.336709 Oct 04 14:36:29.420268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 502/1026] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:29 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1745 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:29.423942 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-37179b9b-6ee9-4420-810e-0070b6f50f88 req-bc31b8d0-0da0-45b2-9a02-1791d80e5b30 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:29.424452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-37179b9b-6ee9-4420-810e-0070b6f50f88 req-bc31b8d0-0da0-45b2-9a02-1791d80e5b30 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:29.425647 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-37179b9b-6ee9-4420-810e-0070b6f50f88 req-bc31b8d0-0da0-45b2-9a02-1791d80e5b30 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:29.443414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-37179b9b-6ee9-4420-810e-0070b6f50f88 req-bc31b8d0-0da0-45b2-9a02-1791d80e5b30 service nova] Creating event network-changed:c36c3311-21de-407e-a97a-632316d80eb7 for instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f on hv-cinder-86026 Oct 04 14:36:29.450431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-37179b9b-6ee9-4420-810e-0070b6f50f88 req-bc31b8d0-0da0-45b2-9a02-1791d80e5b30 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043306 Oct 04 14:36:29.454302 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 525/1027] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:30.125727 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:30.129399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:30.158863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:30.159772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:30.160462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:30.161441 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:30.162335 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:30.163569 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:30.233790 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2a7b8036-a2fe-4ae0-ad96-4d9d708ca316 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113614 Oct 04 14:36:30.235458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 503/1028] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:30 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:30.247697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:30.248277 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:30.269948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:30.273510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:30.277930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:30.281720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:30.284820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:30.287433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:30.380938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-307bac58-d83e-4e7a-a14f-c2c2719b6d6b tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/60338fd1-2276-47fa-8d89-02af6a32c892" status: 200 len: 194 microversion: 2.1 time: 0.138451 Oct 04 14:36:30.393463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 526/1029] 10.222.0.64 () {58 vars in 1413 bytes} [Tue Oct 4 14:36:30 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/60338fd1-2276-47fa-8d89-02af6a32c892 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:30.459782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:30.463290 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:30.481005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:30.481005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:30.481005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:30.481005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:30.481681 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:30.481681 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:30.491821 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:30.833908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:30.873450 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:30.877300 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:30.879770 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c4693b53-1937-42fe-9f7f-da2636e8e3a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1745 microversion: 2.20 time: 0.435816 Oct 04 14:36:30.884026 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 504/1030] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:30 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1745 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:31.476637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-5745173b-658f-4703-997d-31e3a3c23141 req-ca672bdf-ccfa-4e4e-9c87-87a9ea527110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "name": "network-vif-plugged", "status": "completed", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:31.502092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-5745173b-658f-4703-997d-31e3a3c23141 req-ca672bdf-ccfa-4e4e-9c87-87a9ea527110 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:31.503129 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-5745173b-658f-4703-997d-31e3a3c23141 req-ca672bdf-ccfa-4e4e-9c87-87a9ea527110 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:31.503813 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-5745173b-658f-4703-997d-31e3a3c23141 req-ca672bdf-ccfa-4e4e-9c87-87a9ea527110 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:31.542957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-5745173b-658f-4703-997d-31e3a3c23141 req-ca672bdf-ccfa-4e4e-9c87-87a9ea527110 service nova] Creating event network-vif-plugged:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:36:31.580688 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-5745173b-658f-4703-997d-31e3a3c23141 req-ca672bdf-ccfa-4e4e-9c87-87a9ea527110 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093033 Oct 04 14:36:31.587560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 527/1031] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:31.915309 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:31.919842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:31.945417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:31.946289 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:31.947091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:31.949095 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:31.949916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:31.951066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:32.094512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e949e97c-2adb-4c59-942d-34969bbc756b"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:32.103055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:32.117625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:32.118994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:32.120435 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:32.121866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:32.122671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:32.123410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:32.292724 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:32.316929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:32.321018 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:32.323161 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f37c3a09-ce7d-4f2c-9b48-f2f9c242b31a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.416130 Oct 04 14:36:32.334516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 505/1032] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:31 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:33.368213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:33.370525 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:33.387041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:33.387985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:33.389118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:33.390817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:33.392350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:33.393538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:33.647371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:33.665777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:33.669390 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:33.675217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f073218c-d108-45f1-ab6e-d5124d41e319 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.316448 Oct 04 14:36:33.676146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 506/1033] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:33 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:34.712903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:34.715600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:34.725672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:34.726801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:34.727550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:34.728614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:34.729649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:34.730732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:34.973868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:34.994347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:34.997054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:34.998329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b114658a-9a3d-4a92-83a9-8de5d9318b05 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.292626 Oct 04 14:36:35.012341 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 507/1034] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:34 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:35.091564 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b6b0fd8a-f72d-4e28-b180-15eb2430909d tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "POST /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.004748 Oct 04 14:36:35.100838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 528/1035] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:36:32 2022] POST /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments => generated 194 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:36.034628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:36.037800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:36.049662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:36.050394 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:36.051016 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:36.052601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:36.053361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:36.053953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:36.299760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:36.312936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:36.316022 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:36.317721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-26b7ee50-d97a-43a5-b0f4-317140029ebc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.295968 Oct 04 14:36:36.318831 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 508/1036] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:36 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:37.361181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:37.362171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:37.399327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:37.400164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:37.400844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:37.401916 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:37.402564 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:37.403167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:37.592491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:37.602277 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:37.604972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:37.607469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-dd9afdbb-98db-4967-81c7-822d10235085 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.265404 Oct 04 14:36:37.608384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 529/1037] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:37 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:38.638361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:38.638989 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:38.646540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:38.647062 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:38.647495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:38.648271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:38.649048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:38.649485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:38.861877 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:38.872632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:38.874321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:38.876226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d075b1da-8c32-47c6-8290-d83184105ab4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.241972 Oct 04 14:36:38.877434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 509/1038] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:38 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:39.927753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:39.929655 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:39.946992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:39.950385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:39.951479 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:39.952144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:39.952963 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:39.953617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:39.954214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:40.123333 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:40.135345 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:40.137398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:40.139706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c0d34b54-fb81-4375-ae98-f62bb8dea8aa tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.219354 Oct 04 14:36:40.141632 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 530/1039] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:39 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:41.175313 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:41.175927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:41.187684 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:41.188721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:41.189331 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:41.190080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:41.190562 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:41.191169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:41.399538 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:41.418330 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:41.421172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:41.423817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6788566b-6c42-4ae5-8e4c-379d3fb8ee24 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.253598 Oct 04 14:36:41.425037 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 510/1040] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:41 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:42.471859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:42.474732 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:42.492608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:42.493219 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:42.493803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:42.495313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:42.495921 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:42.497582 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:42.741989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:42.751432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:42.752906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:42.754318 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cd009138-b73a-4ea3-90b4-98fca2197f70 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1740 microversion: 2.20 time: 0.288262 Oct 04 14:36:42.755379 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 531/1041] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:42 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:43.025175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:43.027508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:43.034643 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.035120 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.035543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.036279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.036772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.037233 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.070177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e839e710-1ddc-4e4f-b7f0-ec0e49f07990 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048899 Oct 04 14:36:43.070753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 511/1042] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:43 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:43.225304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:43.225791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:43.233037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.233580 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.234153 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.235005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.235589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.236063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.276670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d2782734-06d9-4f73-9871-0c99de62afe3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/60338fd1-2276-47fa-8d89-02af6a32c892" status: 200 len: 194 microversion: 2.1 time: 0.055292 Oct 04 14:36:43.277290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 532/1043] 10.222.0.64 () {58 vars in 1413 bytes} [Tue Oct 4 14:36:43 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/60338fd1-2276-47fa-8d89-02af6a32c892 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:43.288164 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:43.288735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:43.295837 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.296343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.296787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.297490 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.297938 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.298365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.386899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'services' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:43.470147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1d313512-bc6d-4e46-98ac-2a11407fd397 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/60338fd1-2276-47fa-8d89-02af6a32c892" status: 202 len: 0 microversion: 2.1 time: 0.185732 Oct 04 14:36:43.474226 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 512/1044] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:36:43 2022] DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/60338fd1-2276-47fa-8d89-02af6a32c892 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:36:43.780985 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:43.782278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:43.789462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.790361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.790361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.790962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:43.792154 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:43.792811 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:43.998100 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:44.007375 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:44.008870 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:44.010791 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-589d179a-0751-4baa-a593-3e85cbc77aca tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1722 microversion: 2.20 time: 0.233953 Oct 04 14:36:44.011765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 533/1045] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:43 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:45.043434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:45.044140 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:45.051557 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:45.052098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:45.052582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:45.053293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:45.053748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:45.054170 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:45.206208 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:45.223327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:45.226173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:45.228385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d96b34a9-3800-442e-b871-e5655448437f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1722 microversion: 2.20 time: 0.190272 Oct 04 14:36:45.230091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 513/1046] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:45 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:45.669061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:45.669676 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:45.676191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:45.676700 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:45.677124 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:45.677816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:45.678264 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:45.678698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:45.710937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-be8e6920-048f-440b-8396-1aed6864e570 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/e949e97c-2adb-4c59-942d-34969bbc756b" status: 200 len: 194 microversion: 2.1 time: 0.045867 Oct 04 14:36:45.711551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 534/1047] 10.222.0.64 () {58 vars in 1413 bytes} [Tue Oct 4 14:36:45 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/e949e97c-2adb-4c59-942d-34969bbc756b => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:45.723083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:45.723582 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:45.732482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:45.733028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:45.733433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:45.734173 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:45.734633 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:45.736168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:45.838855 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'services' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:45.921132 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c04795da-4a22-444a-b3b2-0de888e2f076 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/e949e97c-2adb-4c59-942d-34969bbc756b" status: 202 len: 0 microversion: 2.1 time: 0.200895 Oct 04 14:36:45.921903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 514/1048] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:36:45 2022] DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments/e949e97c-2adb-4c59-942d-34969bbc756b => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:36:46.257127 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:46.257794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:46.264590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:46.265097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:46.265535 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:46.266252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:46.266714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:46.267135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:46.415584 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:46.424684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:46.426138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:46.427322 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-09d64fe2-bbb7-4879-9c90-3bb23a7ea454 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1722 microversion: 2.20 time: 0.174217 Oct 04 14:36:46.427892 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 535/1049] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:46 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:47.443657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-23163456-6c1b-453c-9b33-b493bcc64648 req-180719ee-3279-4b52-aa3e-6205b26116ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "name": "network-vif-unplugged", "status": "completed", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:47.454755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:47.456955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:47.467820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:47.468612 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:47.469059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:47.469775 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:47.470406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:47.470838 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:47.477286 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-23163456-6c1b-453c-9b33-b493bcc64648 req-180719ee-3279-4b52-aa3e-6205b26116ed service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:47.477767 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-23163456-6c1b-453c-9b33-b493bcc64648 req-180719ee-3279-4b52-aa3e-6205b26116ed service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:47.478198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-23163456-6c1b-453c-9b33-b493bcc64648 req-180719ee-3279-4b52-aa3e-6205b26116ed service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:47.503916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-23163456-6c1b-453c-9b33-b493bcc64648 req-180719ee-3279-4b52-aa3e-6205b26116ed service nova] Creating event network-vif-unplugged:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:36:47.509418 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-23163456-6c1b-453c-9b33-b493bcc64648 req-180719ee-3279-4b52-aa3e-6205b26116ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070320 Oct 04 14:36:47.514291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 515/1050] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:47.631342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:47.641279 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:47.642727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:47.643908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-63a5d9b5-35f4-4aef-b49f-cfb3156bf4b4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1725 microversion: 2.20 time: 0.193297 Oct 04 14:36:47.645037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 536/1051] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:47 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:47.676501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72141eca-2f78-4f79-b028-2fd116901b37"}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:47.679082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:47.686560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:47.687292 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:47.687733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:47.688508 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:47.689254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:47.689382 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.013620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f87eb769-bb8e-440e-a72d-626e36e4550d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341504 Oct 04 14:36:48.019774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 516/1052] 10.222.0.64 () {62 vars in 1364 bytes} [Tue Oct 4 14:36:47 2022] POST /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 14:36:48.183589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:48.184082 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:48.190201 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:48.190695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:48.191126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.191831 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:48.192280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:48.192724 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.196896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:48.511582 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2ad1b6aa-3018-40f3-a97c-ff4b6bf29b2c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-volume_attachments/72141eca-2f78-4f79-b028-2fd116901b37" status: 202 len: 0 microversion: 2.20 time: 0.331388 Oct 04 14:36:48.512276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 537/1053] 10.222.0.64 () {60 vars in 1457 bytes} [Tue Oct 4 14:36:48 2022] DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-volume_attachments/72141eca-2f78-4f79-b028-2fd116901b37 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 14:36:48.577007 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:48.577593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:48.586198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:48.586686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:48.587126 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.587860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:48.588355 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:48.588787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.613223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:48.626163 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120820) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 14:36:48.701858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e0cfe6c3-2b8b-4ccc-9558-54c7fb85b26a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "POST /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/action" status: 202 len: 0 microversion: 2.20 time: 0.129618 Oct 04 14:36:48.702458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 517/1054] 10.222.0.64 () {62 vars in 1319 bytes} [Tue Oct 4 14:36:48 2022] POST /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:36:48.710669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:48.711288 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:48.718879 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:48.719376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:48.719877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.720706 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:48.721257 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:48.721807 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:48.905812 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:48.914755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:48.916975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:48.918467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d1451d95-a5e8-4dad-86f3-dbad71b5d46a tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1673 microversion: 2.20 time: 0.211722 Oct 04 14:36:48.919037 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 538/1055] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:48 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1673 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:49.280447 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:49.283368 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:49.292282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.292873 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.293319 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.294059 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.294517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.294947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.334910 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-40cbd95e-7f94-42b8-b708-c62782d08b29 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058710 Oct 04 14:36:49.335507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 518/1056] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:49 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:36:49.464702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:49.467048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:49.473809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.474295 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.474727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.475439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.475888 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.476339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.512574 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-65d0603d-8f62-4f5d-a842-ac41787627ab tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052147 Oct 04 14:36:49.514598 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 539/1057] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:49 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:36:49.584454 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:49.585079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:49.592459 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.592943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.593371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.594080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.594524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.594945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.624476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:36:49.718493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fb5e85f1-e9e5-4170-972d-ba259ea44b54 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 204 len: 0 microversion: 2.1 time: 0.137803 Oct 04 14:36:49.719391 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 519/1058] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:36:49 2022] DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 14:36:49.727522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:49.728147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:49.735159 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.735644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.736074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.736802 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.737245 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.737663 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.883344 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:49.891986 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2728852d-8ad7-4882-96e1-9810df6419da tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1671 microversion: 2.1 time: 0.168338 Oct 04 14:36:49.892589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 540/1059] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:49 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:49.945455 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:49.946065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:49.953254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.953861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.954399 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:49.955297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:49.955924 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:49.956489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:50.100550 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:50.109080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:50.110533 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:50.111704 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-987fc581-5665-455e-9420-04db9725350c tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.170776 Oct 04 14:36:50.112270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 520/1060] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:49 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:50.915323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:50.916085 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:50.925737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:50.926551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:50.927276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:50.928469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:50.929239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:50.929951 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:51.080004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:51.096040 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-3395f1fb-6ac9-4aff-9dd8-ec9648b71a44 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1671 microversion: 2.1 time: 0.184214 Oct 04 14:36:51.097184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 541/1061] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:50 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:51.138138 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:51.138737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:51.145518 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:51.146045 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:51.146415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:51.147124 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:51.147576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:51.147991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:51.291393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:51.300359 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:51.301817 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:51.303035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5c6bc33f-1528-4f43-b5c9-239ee505f734 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.169525 Oct 04 14:36:51.303612 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 521/1062] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:51 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:52.122183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:52.122803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:52.130945 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:52.131486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:52.131971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:52.132740 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:52.133359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:52.133831 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:52.332254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:52.334215 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:52.337155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:52.349985 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:52.356294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:52.357451 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:52.358044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:52.358836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:52.361686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:52.362130 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:52.370992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-dddafa3b-d782-46a7-a501-c5a22d71ac40 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1671 microversion: 2.1 time: 0.253424 Oct 04 14:36:52.371602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 542/1063] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:52 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:52.618456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:52.630665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:52.633746 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:52.635597 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c642aa88-562f-451e-9e62-34854202de90 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.309224 Oct 04 14:36:52.636229 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 522/1064] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:52 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:36:53.398905 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:53.399625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:53.411764 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:53.412957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:53.413942 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:53.415426 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:53.416371 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:53.417118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:53.498921 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-284f5571-e03e-422d-988f-ebe6c03078e4 req-d80fa857-da65-46f3-833e-72d32a3d4838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5dac79-f96d-476e-afb9-50602d68e5ae", "name": "network-vif-deleted", "tag": "e72efce6-2833-4437-98f6-0d6dbe747184"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:53.526505 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-284f5571-e03e-422d-988f-ebe6c03078e4 req-d80fa857-da65-46f3-833e-72d32a3d4838 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:53.527064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-284f5571-e03e-422d-988f-ebe6c03078e4 req-d80fa857-da65-46f3-833e-72d32a3d4838 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:53.527778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-284f5571-e03e-422d-988f-ebe6c03078e4 req-d80fa857-da65-46f3-833e-72d32a3d4838 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:53.556560 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-284f5571-e03e-422d-988f-ebe6c03078e4 req-d80fa857-da65-46f3-833e-72d32a3d4838 service nova] Creating event network-vif-deleted:e72efce6-2833-4437-98f6-0d6dbe747184 for instance 1a5dac79-f96d-476e-afb9-50602d68e5ae on hv-cinder-86026 Oct 04 14:36:53.568680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-284f5571-e03e-422d-988f-ebe6c03078e4 req-d80fa857-da65-46f3-833e-72d32a3d4838 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077493 Oct 04 14:36:53.569646 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 523/1065] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:53.674797 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:53.675491 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:53.692613 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:53.692967 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:53.693301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:53.694265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:53.694934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:53.695549 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:53.959742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:53.971211 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0a317473-9a4b-4feb-99d8-4452235d48a3 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1604 microversion: 2.1 time: 0.579115 Oct 04 14:36:53.972137 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 543/1066] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:53 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1604 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:54.022295 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:54.039863 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:54.041493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:54.042807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fbddb845-8e15-446b-9f43-e367765efbf1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.372432 Oct 04 14:36:54.043392 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 524/1067] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:53 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:54.692836 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-819710087"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:54.694059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:54.707862 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:54.709043 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:54.709661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:54.711094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:54.712256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:54.714553 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:54.887326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.network.security_group_api [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Removing security group bc570813-e84d-4bd0-aa5f-a8c0b290be17 from port 15011792-a2ae-4555-bb5e-f16eac3afea0 Oct 04 14:36:55.001736 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:55.002511 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:55.024858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:55.025467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:55.026206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:55.026960 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:55.027433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:55.027861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:55.079461 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:55.079971 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:55.080728 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:55.081531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:55.156139 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:55.173673 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a779ca1e-980d-40a3-8f42-a85f910a34b9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.176965 Oct 04 14:36:55.174902 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 525/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:54 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:36:55.180038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:55.180927 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:55.188564 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:55.189337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:55.189943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:55.190865 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:55.191489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:55.192078 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:55.557429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:55.571097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:55.574698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:55.576985 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-eb7cf6b8-0598-4d45-9a3f-4ae5889a9675 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.400318 Oct 04 14:36:55.577942 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 526/1069] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:55 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:55.651781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-860747da-9700-4f0b-aff2-09d9784d55f9 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/action" status: 202 len: 0 microversion: 2.1 time: 0.962963 Oct 04 14:36:55.659781 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 544/1070] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:36:54 2022] POST /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/action => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:36:55.662846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-19bce413-6df8-4f96-b476-7a8eba37431e req-1d0c05c4-ab4e-4c91-8c2e-b4b62f224643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:55.675882 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-19bce413-6df8-4f96-b476-7a8eba37431e req-1d0c05c4-ab4e-4c91-8c2e-b4b62f224643 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:55.677029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-19bce413-6df8-4f96-b476-7a8eba37431e req-1d0c05c4-ab4e-4c91-8c2e-b4b62f224643 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:55.678411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-19bce413-6df8-4f96-b476-7a8eba37431e req-1d0c05c4-ab4e-4c91-8c2e-b4b62f224643 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:55.705316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-19bce413-6df8-4f96-b476-7a8eba37431e req-1d0c05c4-ab4e-4c91-8c2e-b4b62f224643 service nova] Creating event network-changed:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:36:55.714498 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-19bce413-6df8-4f96-b476-7a8eba37431e req-1d0c05c4-ab4e-4c91-8c2e-b4b62f224643 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054843 Oct 04 14:36:55.716418 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 527/1071] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:56.219145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:56.221020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:56.241414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:56.242239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:56.242866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:56.243820 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:56.244510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:56.245327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:56.296998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:56.297795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:56.298968 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:56.299606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:56.428863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:56.449672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-06f2097a-a5f8-4fb8-bdb5-28a1f8bad25c tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.241681 Oct 04 14:36:56.451095 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 545/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:56 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:56.612871 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:56.617804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:56.630715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:56.631222 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:56.631672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:56.632468 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:56.632944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:56.633383 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:56.844128 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:56.864824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:56.869503 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:56.871975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8d645ebe-0e6f-4429-92f2-4420f8fc60dc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.263729 Oct 04 14:36:56.885153 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 528/1073] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:56 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:57.475761 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:57.476642 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:57.489748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.490717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.491432 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.492342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.492847 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.493565 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.569528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.571021 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.572898 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.573997 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:57.662067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:57.678933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5b2f469b-0f09-4295-beda-004806c1da2a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.207892 Oct 04 14:36:57.682145 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:57.683995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:57.684227 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 546/1074] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:57 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:57.696299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.697904 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.701076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.701076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.701076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.701076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.741860 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-05508e98-a353-4f56-925a-e4cffa06dd7e req-661fe826-7d87-4198-8c21-981202e3f9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:36:57.758743 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-05508e98-a353-4f56-925a-e4cffa06dd7e req-661fe826-7d87-4198-8c21-981202e3f9a4 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.759234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-05508e98-a353-4f56-925a-e4cffa06dd7e req-661fe826-7d87-4198-8c21-981202e3f9a4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.760490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-05508e98-a353-4f56-925a-e4cffa06dd7e req-661fe826-7d87-4198-8c21-981202e3f9a4 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.785048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-05508e98-a353-4f56-925a-e4cffa06dd7e req-661fe826-7d87-4198-8c21-981202e3f9a4 service nova] Creating event network-changed:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:36:57.793151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-05508e98-a353-4f56-925a-e4cffa06dd7e req-661fe826-7d87-4198-8c21-981202e3f9a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054480 Oct 04 14:36:57.793879 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 547/1075] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:36:57.831979 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lazy-loading 'services' on Instance uuid 6f1be2bd-b5b7-4a54-9196-df2b3061d70e {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:57.954026 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:57.956190 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:57.970410 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.971809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.973052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:57.975457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:57.977081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:57.978949 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:58.039066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-23d0fda2-f0a3-4cd3-b310-1107b2b6c6aa tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments/cf907a63-3faf-47f0-9610-9c4714053bb8" status: 202 len: 0 microversion: 2.1 time: 0.365055 Oct 04 14:36:58.040515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 529/1076] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:36:57 2022] DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments/cf907a63-3faf-47f0-9610-9c4714053bb8 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:36:58.069232 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:58.089358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:58.108807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:58.109324 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:58.110046 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:58.111315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:58.112048 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:58.115689 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:58.205192 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-40b037b0-f33c-44d1-a2a8-0defb7a6694c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159323 Oct 04 14:36:58.208373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 530/1077] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:58 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:58.262323 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:58.280022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:58.283260 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:58.285646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-cdc73db7-0403-4f63-a512-be6f3cdd5579 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.349470 Oct 04 14:36:58.287451 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 548/1078] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:57 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:58.708214 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:58.711841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:58.724622 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:58.725909 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:58.726706 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:58.727583 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:58.729193 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:58.729733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:58.786435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:58.786856 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:58.787302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:58.787906 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:36:58.792443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:36:58.860778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:58.871380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4616b50b-483c-4e20-9f70-84d7dc4c0f38 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.170364 Oct 04 14:36:58.887396 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 531/1079] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:58 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:36:59.224365 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:59.232696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:59.246074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.247406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.248650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.250218 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.250948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.251608 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.324593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:59.327363 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:59.337510 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9180af73-5310-43c3-92d2-1c68f305c593 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118567 Oct 04 14:36:59.342988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.343950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.345047 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.346773 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 549/1080] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:36:59 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:36:59.347299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.348107 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.349088 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.580370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:59.594135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:59.595664 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:36:59.596945 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fd9fb33d-4d90-41bd-8302-198b27f2fac5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.281851 Oct 04 14:36:59.597555 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 532/1081] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:36:59 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:36:59.899461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:36:59.900615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:36:59.910492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.910994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.911437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.912155 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.912644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.913067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.955142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:36:59.955633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:36:59.956081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:36:59.956638 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:00.003208 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:00.014327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-109e326f-b9d2-467d-ad2a-861d635c1a67 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.121561 Oct 04 14:37:00.015413 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 550/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:36:59 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:00.356054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:00.360032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:00.369851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:00.369851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:00.369851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:00.370625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:00.370832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:00.371504 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:00.413578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d55208db-957d-4c72-99cd-c40cc679f1ec tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062547 Oct 04 14:37:00.415259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 533/1083] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:00 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:37:00.626027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:00.628118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:00.637538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:00.638411 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:00.638925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:00.639776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:00.640339 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:00.640853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:00.657681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:00.833027 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:00.843373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:00.844975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:00.846306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aad4198d-5145-489b-9851-bab940b27815 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.225238 Oct 04 14:37:00.846871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 551/1084] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:00 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:01.057409 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:01.059212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:01.069748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.070516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.071270 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:01.072674 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.073744 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.074554 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:01.120353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.120353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.120353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:01.120353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:01.173647 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:01.186756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-813592f4-882d-4f68-a6f1-01968113c2f9 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.137180 Oct 04 14:37:01.187572 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 534/1085] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:01 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:01.440235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:01.443277 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:01.466177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.469373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.469373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:01.469373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.469373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.470036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:01.686280 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8e7343a0-23a6-4c2c-94e7-d056177b1155 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261198 Oct 04 14:37:01.691215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 552/1086] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:01 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:01.873361 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:01.874005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:01.880748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.881488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.881929 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:01.882725 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:01.883130 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:01.883584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:02.035159 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:02.046587 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:02.047012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:02.047903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-20095e0d-6e2a-4a45-8cfe-3d0aa19fe865 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.179101 Oct 04 14:37:02.048492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 535/1087] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:01 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:02.211845 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:02.212828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:02.219536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:02.220059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:02.220528 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:02.221363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:02.221698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:02.222123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:02.257780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:02.258266 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:02.259214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:02.259890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:02.308486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:02.320123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-71449d4f-a582-4fb4-ac52-3c6b8837aa1e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.112164 Oct 04 14:37:02.321166 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 553/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:02 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:37:02.700898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:02.703231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:02.715500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:02.715500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:02.715500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:02.715500 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:02.716005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:02.716005 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:02.747188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f8adda0a-3421-4283-9f33-0da417222d26 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052111 Oct 04 14:37:02.752492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 536/1089] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:02 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:03.075625 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:03.076362 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:03.082645 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.083133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.083563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.084272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.084753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.085179 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.230207 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:03.239138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:03.240703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:03.241874 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fba0658b-5f95-4fc1-a8e5-8e99a7c62117 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.170635 Oct 04 14:37:03.242422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 554/1090] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:03 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:03.343540 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:03.344395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:03.351188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.351681 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.352128 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.352883 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.353347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.353943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.391874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.392404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.392855 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.393316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lazy-loading 'fault' on Instance uuid 1a5dac79-f96d-476e-afb9-50602d68e5ae {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:03.446188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc02bb4b8a32400faef8743d2418a648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4fa5d0aa0e4bf98816e4600023ca99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:03.455866 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-419cb902-3a20-47f6-8888-100a07e6ab94 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 200 len: 1326 microversion: 2.1 time: 0.115866 Oct 04 14:37:03.456064 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 537/1091] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:03 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:03.759720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:03.762074 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:03.768188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.768704 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.769144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.769844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:03.770295 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:03.770720 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:03.801881 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-979ab88f-4ea3-496b-8583-2302b1229c39 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Oct 04 14:37:03.802463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 555/1092] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:03 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:04.269098 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:04.269614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:04.276218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:04.276732 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:04.277163 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:04.277848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:04.278294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:04.278709 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:04.410176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:04.419077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:04.420570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:04.421741 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6aa70722-94a3-4e07-9c04-c20fd0fc468d tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.156692 Oct 04 14:37:04.422308 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 538/1093] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:04 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:37:04.481415 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:04.482241 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:04.489436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:04.489436 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:04.489937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:04.490696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:04.491235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:04.491716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:04.506725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] HTTP exception thrown: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Request method failure captured: Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae HTTP/1.1 Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENlUieDFIvtQ-j8JoX6PIJbf76a2YWuw2B7dat7Y14d-P8pYVyKoZGRHwcRUSdjgCfGLvEhlgsOJN3Y2xmcJuUhnwuh9PI9JygsMctaaf2CSH62k4yOVQ19rtgH9SkOcofD4hgMw69hIe-1kjFBUcWOOWwKMwavfjO8y8ucQVTLX_I Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:04.508405 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a4fa5d0aa0e4bf98816e4600023ca99", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fc02bb4b8a32400faef8743d2418a648 Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:04.510606 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '1a5dac79-f96d-476e-afb9-50602d68e5ae'} Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:04.511651 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:04.513177 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:04.514522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Returning 404 to user: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:04.514522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a364fb9b-30f3-4fc0-ac44-1f9c6e6dbda5 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 404 len: 111 microversion: 2.1 time: 0.032784 Oct 04 14:37:04.516092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 556/1094] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:04 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:04.518832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-fdf5ed0b-d2ec-4d0f-9a20-50df7b1e835a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '.version_select at 0x7f5718850af0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:04.539057 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-fdf5ed0b-d2ec-4d0f-9a20-50df7b1e835a tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-506639375" status: 202 len: 0 microversion: 2.1 time: 0.023953 Oct 04 14:37:04.543337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 539/1095] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Oct 4 14:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-506639375 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:37:04.815703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:04.818167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:04.825473 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:04.825973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:04.826421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:04.827215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:04.827684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:04.828119 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:04.864848 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0dfdede8-eeb6-4dfa-b631-e3350bde3ebc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053197 Oct 04 14:37:04.865590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 557/1096] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:04 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:37:05.452251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:05.452251 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:05.456082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:05.456676 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:05.457432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:05.459100 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:05.459758 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:05.460379 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:05.702425 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:05.713383 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:05.715271 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:05.716931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5830bfe9-cdb9-4ba0-8723-d4971b9e6a02 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.273822 Oct 04 14:37:05.717911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 540/1097] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:05 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:05.878194 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:05.880293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:05.888105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:05.888846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:05.889276 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:05.889974 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:05.890416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:05.891009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:05.921745 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e9e8c093-fb43-4af9-9247-efb627828efc tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047503 Oct 04 14:37:05.922312 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 558/1098] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:05 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:37:05.933721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:05.934230 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:05.940961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:05.941476 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:05.942148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:05.942903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:05.943385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:05.943806 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:06.025796 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] HTTP exception thrown: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e is not attached to volume cf907a63-3faf-47f0-9610-9c4714053bb8 Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Request method failure captured: Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments/cf907a63-3faf-47f0-9610-9c4714053bb8 HTTP/1.1 Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPERI7jw3pw28p2VLHiofQAejuZwgURpQCsN-wsVWL54Bylx9WLkfsfTHcKtM6q22tenzCh__lVKwotj5_HbENTQ8K73ThjtlOTxHSvKzjcY4cDgpk2PKHTMndEKfTIKalN1AzGlqP0dXpJtRNZfLgdBlWpee83xOgrtfrqy659uq1yM Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 9cf9a725cf7e42ea939bee84113b12ee Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-TestMinimumBasicScenario-499070544 Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:06.038029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9cf9a725cf7e42ea939bee84113b12ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9cf9a725cf7e42ea939bee84113b12ee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9cf9a725cf7e42ea939bee84113b12ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9cf9a725cf7e42ea939bee84113b12ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-TestMinimumBasicScenario-499070544 Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 9cf9a725cf7e42ea939bee84113b12ee Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-TestMinimumBasicScenario-499070544 Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-TestMinimumBasicScenario-499070544-project Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: cab40292db0d4a74b1fd59c3539e81e3 Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-TestMinimumBasicScenario-499070544-project Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:06.040509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e is not attached to volume cf907a63-3faf-47f0-9610-9c4714053bb8 Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'server_id': '6f1be2bd-b5b7-4a54-9196-df2b3061d70e', 'id': 'cf907a63-3faf-47f0-9610-9c4714053bb8'} Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cf907a63-3faf-47f0-9610-9c4714053bb8. Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:06.041755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e is not attached to volume cf907a63-3faf-47f0-9610-9c4714053bb8 Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e is not attached to volume cf907a63-3faf-47f0-9610-9c4714053bb8 Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:06.043183 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Returning 404 to user: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e is not attached to volume cf907a63-3faf-47f0-9610-9c4714053bb8 {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:06.044126 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-69a15d61-0128-4615-91e7-a30585cd311e tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments/cf907a63-3faf-47f0-9610-9c4714053bb8" status: 404 len: 154 microversion: 2.1 time: 0.111217 Oct 04 14:37:06.044126 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 541/1099] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:37:05 2022] DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e/os-volume_attachments/cf907a63-3faf-47f0-9610-9c4714053bb8 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:06.744674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:06.745292 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:06.751569 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:06.752059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:06.752524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:06.753244 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:06.753728 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:06.754160 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:06.891538 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:06.901310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:06.902903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:06.904018 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0f4a8ab8-e2a7-4a91-a2f6-818da8645590 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.163992 Oct 04 14:37:06.904948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 559/1100] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:06 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:07.194598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:07.195176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:07.203458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.203931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.204430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.205169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.205628 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.206059 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.234081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:37:07.317660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e5942bbc-19d5-4d30-97f8-96b6e6538759 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 204 len: 0 microversion: 2.1 time: 0.126863 Oct 04 14:37:07.318304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 542/1101] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:07 2022] DELETE /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:37:07.329692 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:07.330505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:07.337721 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.338332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.338814 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.339653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.340224 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.340723 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.476633 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:07.485176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2c24ceb4-5578-4fa5-96d0-34673d27d90c tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1554 microversion: 2.1 time: 0.159543 Oct 04 14:37:07.486142 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 560/1102] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:07 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:07.554660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:07.555360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:07.561579 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.562065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.562505 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.563203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.563662 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.564089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.578312 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] HTTP exception thrown: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Request method failure captured: Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae HTTP/1.1 Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENlUieDFIvtQ-j8JoX6PIJbf76a2YWuw2B7dat7Y14d-P8pYVyKoZGRHwcRUSdjgCfGLvEhlgsOJN3Y2xmcJuUhnwuh9PI9JygsMctaaf2CSH62k4yOVQ19rtgH9SkOcofD4hgMw69hIe-1kjFBUcWOOWwKMwavfjO8y8ucQVTLX_I Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:07.579905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a4fa5d0aa0e4bf98816e4600023ca99", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: fc02bb4b8a32400faef8743d2418a648 Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.581722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '1a5dac79-f96d-476e-afb9-50602d68e5ae'} Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:07.582517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.583998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.585488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Returning 404 to user: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:07.585488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4da24afb-13be-41e8-9c4d-bbb0f3f005a0 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 404 len: 111 microversion: 2.1 time: 0.031024 Oct 04 14:37:07.585488 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 543/1103] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:07 2022] DELETE /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:07.590855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:07.591517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 1a5dac79-f96d-476e-afb9-50602d68e5ae] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:07.597850 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.598346 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.598783 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.599478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.599928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.600373 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.614659 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] HTTP exception thrown: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Request method failure captured: Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae HTTP/1.1 Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENlUieDFIvtQ-j8JoX6PIJbf76a2YWuw2B7dat7Y14d-P8pYVyKoZGRHwcRUSdjgCfGLvEhlgsOJN3Y2xmcJuUhnwuh9PI9JygsMctaaf2CSH62k4yOVQ19rtgH9SkOcofD4hgMw69hIe-1kjFBUcWOOWwKMwavfjO8y8ucQVTLX_I Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:07.616180 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a4fa5d0aa0e4bf98816e4600023ca99", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fc02bb4b8a32400faef8743d2418a648 Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.617790 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '1a5dac79-f96d-476e-afb9-50602d68e5ae'} Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:07.619291 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. Oct 04 14:37:07.620635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:07.621785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Returning 404 to user: Instance 1a5dac79-f96d-476e-afb9-50602d68e5ae could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:07.621785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-211eea0e-a75e-456f-a804-f58d09dd6100 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae" status: 404 len: 111 microversion: 2.1 time: 0.031448 Oct 04 14:37:07.621785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 561/1104] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:07 2022] GET /compute/v2.1/servers/1a5dac79-f96d-476e-afb9-50602d68e5ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:07.931377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:07.931992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:07.938121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.938603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.939041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:07.940071 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:07.940563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:07.940998 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:08.073693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:08.081900 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:08.083342 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:08.084524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-17e53cb9-9eae-405e-a49f-aac14a46fffe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.157180 Oct 04 14:37:08.085084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 544/1105] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:07 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:37:08.509600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:08.510480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:08.517169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:08.517654 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:08.518088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:08.518800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:08.519252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:08.519666 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:08.660006 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:08.668530 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0a2d3fd1-9641-4697-8e75-6296aa985760 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1554 microversion: 2.1 time: 0.163024 Oct 04 14:37:08.669092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 562/1106] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:08 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:37:09.109466 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:09.110088 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:09.116655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:09.117146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:09.117605 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:09.118429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:09.118826 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:09.119252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:09.255053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:09.263838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:09.265299 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:09.266457 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-58d021d6-12ba-4dcb-af20-53f6a5c62239 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.160971 Oct 04 14:37:09.267011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 545/1107] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:09 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:37:09.691135 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:09.691742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:09.699376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:09.699863 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:09.700326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:09.701031 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:09.701495 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:09.701900 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:09.842602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:09.850873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-6e73f17e-5f64-4db6-9073-5a4d2be53b51 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1554 microversion: 2.1 time: 0.163540 Oct 04 14:37:09.851399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 563/1108] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:09 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:10.292200 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:10.292854 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:10.299405 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:10.299886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:10.300336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:10.301038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:10.301483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:10.301911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:10.435858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:10.444049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:10.445515 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:10.446685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1d87a015-f376-4bf5-a5c7-905179f9435f tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.158829 Oct 04 14:37:10.447356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 546/1109] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:10 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:10.875450 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:10.876084 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:10.878473 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=76 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:10.885640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:10.886140 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:10.886753 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:10.887508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:10.888012 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:10.888469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.028514 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:11.036763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-6fac61a4-9fd7-49df-b4cc-766761ea94d5 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1554 microversion: 2.1 time: 0.165058 Oct 04 14:37:11.037337 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 564/1110] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:10 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:11.473564 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:11.474166 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:11.481708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:11.482913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:11.482913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.483462 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:11.483921 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:11.484373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.504365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:11.627917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:11.636558 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:11.638024 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:11.639198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f6637cf7-1973-4db2-bc1c-e867a7f0bc60 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.169775 Oct 04 14:37:11.639759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 547/1111] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:11 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:11.857517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-74e7010f-e1be-4534-a656-0d15f80698f0 req-30553a0b-a9cd-4944-82fc-3c00a91eac77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "name": "network-vif-plugged", "status": "completed", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:11.867572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-74e7010f-e1be-4534-a656-0d15f80698f0 req-30553a0b-a9cd-4944-82fc-3c00a91eac77 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:11.868782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-74e7010f-e1be-4534-a656-0d15f80698f0 req-30553a0b-a9cd-4944-82fc-3c00a91eac77 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:11.869560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-74e7010f-e1be-4534-a656-0d15f80698f0 req-30553a0b-a9cd-4944-82fc-3c00a91eac77 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.884689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-74e7010f-e1be-4534-a656-0d15f80698f0 req-30553a0b-a9cd-4944-82fc-3c00a91eac77 service nova] Creating event network-vif-plugged:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:37:11.890780 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-74e7010f-e1be-4534-a656-0d15f80698f0 req-30553a0b-a9cd-4944-82fc-3c00a91eac77 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036971 Oct 04 14:37:11.891416 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 565/1112] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:11.944440 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:11.944947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:11.951669 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:11.952181 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:11.952638 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.953356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:11.953819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:11.954260 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.976486 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] HTTP exception thrown: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Request method failure captured: Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 HTTP/1.1 Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENlUieDFIvtQ-j8JoX6PIJbf76a2YWuw2B7dat7Y14d-P8pYVyKoZGRHwcRUSdjgCfGLvEhlgsOJN3Y2xmcJuUhnwuh9PI9JygsMctaaf2CSH62k4yOVQ19rtgH9SkOcofD4hgMw69hIe-1kjFBUcWOOWwKMwavfjO8y8ucQVTLX_I Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:11.979038 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a4fa5d0aa0e4bf98816e4600023ca99", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: fc02bb4b8a32400faef8743d2418a648 Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:11.982235 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '52d55b4f-410d-4527-a9d3-15f1942a46d0'} Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:11.983968 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:11.986387 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:11.988889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Returning 404 to user: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:11.988889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b44b05a2-61a1-4095-91d8-7184bf59435e tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 404 len: 111 microversion: 2.1 time: 0.040130 Oct 04 14:37:11.988889 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 548/1113] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:11 2022] DELETE /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:11.990050 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:11.990760 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] [instance: 52d55b4f-410d-4527-a9d3-15f1942a46d0] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:11.999056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:11.999056 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:11.999406 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:11.999841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:12.000290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:12.000745 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:12.015454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] HTTP exception thrown: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Request method failure captured: Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 HTTP/1.1 Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENlUieDFIvtQ-j8JoX6PIJbf76a2YWuw2B7dat7Y14d-P8pYVyKoZGRHwcRUSdjgCfGLvEhlgsOJN3Y2xmcJuUhnwuh9PI9JygsMctaaf2CSH62k4yOVQ19rtgH9SkOcofD4hgMw69hIe-1kjFBUcWOOWwKMwavfjO8y8ucQVTLX_I Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:12.017157 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3a4fa5d0aa0e4bf98816e4600023ca99", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3a4fa5d0aa0e4bf98816e4600023ca99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 3a4fa5d0aa0e4bf98816e4600023ca99 Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeTestJSON-550167276 Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fc02bb4b8a32400faef8743d2418a648 Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeTestJSON-550167276-project Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:12.018778 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '52d55b4f-410d-4527-a9d3-15f1942a46d0'} Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:12.019763 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. Oct 04 14:37:12.021841 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:12.023770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] Returning 404 to user: Instance 52d55b4f-410d-4527-a9d3-15f1942a46d0 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:12.023770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-690a17aa-2fd1-469c-8a66-5270b224c125 tempest-AttachVolumeTestJSON-550167276 tempest-AttachVolumeTestJSON-550167276-project] 10.222.0.64 "GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0" status: 404 len: 111 microversion: 2.1 time: 0.032990 Oct 04 14:37:12.023770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 566/1114] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:11 2022] GET /compute/v2.1/servers/52d55b4f-410d-4527-a9d3-15f1942a46d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 14:37:12.065663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:12.066920 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:12.077559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:12.078236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:12.078759 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:12.079495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:12.080030 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:12.080563 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:12.669370 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:12.669875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:12.676834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:12.677338 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:12.677770 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:12.678492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:12.678944 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:12.679502 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:12.711801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:12.734175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1d960d59-75ad-473b-9af6-1fce1d27127b tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1554 microversion: 2.1 time: 0.675096 Oct 04 14:37:12.737186 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 549/1115] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:12 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1554 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:12.866287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:12.875952 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:12.877430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:12.879335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a50d77b1-648e-4f19-949c-f2ba5d455d43 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.214043 Oct 04 14:37:12.879925 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 567/1116] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:12 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 14:37:13.356276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-c30fbdc4-c554-492b-ac8d-8f32d8cac309 req-30832c61-2dc8-4b24-90b7-7afcf54365ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1be2bd-b5b7-4a54-9196-df2b3061d70e", "name": "network-vif-deleted", "tag": "15011792-a2ae-4555-bb5e-f16eac3afea0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:13.367385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c30fbdc4-c554-492b-ac8d-8f32d8cac309 req-30832c61-2dc8-4b24-90b7-7afcf54365ed service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:13.368899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c30fbdc4-c554-492b-ac8d-8f32d8cac309 req-30832c61-2dc8-4b24-90b7-7afcf54365ed service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:13.369421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-c30fbdc4-c554-492b-ac8d-8f32d8cac309 req-30832c61-2dc8-4b24-90b7-7afcf54365ed service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:13.381248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-c30fbdc4-c554-492b-ac8d-8f32d8cac309 req-30832c61-2dc8-4b24-90b7-7afcf54365ed service nova] Creating event network-vif-deleted:15011792-a2ae-4555-bb5e-f16eac3afea0 for instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e on hv-cinder-86026 Oct 04 14:37:13.387056 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-c30fbdc4-c554-492b-ac8d-8f32d8cac309 req-30832c61-2dc8-4b24-90b7-7afcf54365ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034749 Oct 04 14:37:13.388351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 550/1117] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:37:13.764517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:13.765138 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:13.775054 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:13.775589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:13.776191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:13.776945 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:13.777399 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:13.785066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:13.831566 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:13.832058 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:13.832517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:13.832994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lazy-loading 'fault' on Instance uuid 6f1be2bd-b5b7-4a54-9196-df2b3061d70e {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:13.880403 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab40292db0d4a74b1fd59c3539e81e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf9a725cf7e42ea939bee84113b12ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:13.892284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-1e44ad8d-06ec-4975-bd0a-35d9b10a11da tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 200 len: 1348 microversion: 2.1 time: 0.131701 Oct 04 14:37:13.892822 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 568/1118] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:13 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 1348 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:13.918259 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:13.919083 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:13.928930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:13.934565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:13.935032 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:13.936698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:13.937520 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:13.940715 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:14.240509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:14.254225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:14.256360 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:14.258135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4a3df5b1-d4c3-4ec5-8faf-05d9933821a8 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1731 microversion: 2.20 time: 0.351563 Oct 04 14:37:14.276417 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 551/1119] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:13 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1731 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:14.899747 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:14.900499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:14.918998 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:14.919654 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:14.920372 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:14.923408 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:14.924478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:14.926635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:14.929279 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:14.931773 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] [instance: 6f1be2bd-b5b7-4a54-9196-df2b3061d70e] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:14.940493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:14.941755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:14.942438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:14.943457 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:14.944282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:14.944832 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:14.963932 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] HTTP exception thrown: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e could not be found. Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Request method failure captured: Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e HTTP/1.1 Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPERI7jw3pw28p2VLHiofQAejuZwgURpQCsN-wsVWL54Bylx9WLkfsfTHcKtM6q22tenzCh__lVKwotj5_HbENTQ8K73ThjtlOTxHSvKzjcY4cDgpk2PKHTMndEKfTIKalN1AzGlqP0dXpJtRNZfLgdBlWpee83xOgrtfrqy659uq1yM Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 9cf9a725cf7e42ea939bee84113b12ee Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-TestMinimumBasicScenario-499070544 Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:14.966206 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9cf9a725cf7e42ea939bee84113b12ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9cf9a725cf7e42ea939bee84113b12ee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9cf9a725cf7e42ea939bee84113b12ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9cf9a725cf7e42ea939bee84113b12ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-TestMinimumBasicScenario-499070544 Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 9cf9a725cf7e42ea939bee84113b12ee Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-TestMinimumBasicScenario-499070544 Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-TestMinimumBasicScenario-499070544-project Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: cab40292db0d4a74b1fd59c3539e81e3 Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-TestMinimumBasicScenario-499070544-project Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e could not be found. Oct 04 14:37:14.967665 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '6f1be2bd-b5b7-4a54-9196-df2b3061d70e'} Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e could not be found. Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:14.969081 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e could not be found. Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e could not be found. Oct 04 14:37:14.970588 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:14.973777 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b673ecd7-a3ec-4ef9-b0e5-3852aff0723b tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/ips" status: 200 len: 149 microversion: 2.1 time: 0.072120 Oct 04 14:37:14.973777 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 569/1120] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:37:14 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/ips => generated 149 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:14.975493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Returning 404 to user: Instance 6f1be2bd-b5b7-4a54-9196-df2b3061d70e could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:14.976656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bc2f40de-b06f-498c-8110-56bf88999e08 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e" status: 404 len: 111 microversion: 2.1 time: 0.052127 Oct 04 14:37:14.978595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 552/1121] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:14 2022] GET /compute/v2.1/servers/6f1be2bd-b5b7-4a54-9196-df2b3061d70e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 14:37:14.988551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-814625b2-50b7-45fb-b5e0-98ee5a2f0045 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] Calling method '.version_select at 0x7f5718646280>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:15.013587 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-814625b2-50b7-45fb-b5e0-98ee5a2f0045 tempest-TestMinimumBasicScenario-499070544 tempest-TestMinimumBasicScenario-499070544-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1397666128" status: 202 len: 0 microversion: 2.1 time: 0.030020 Oct 04 14:37:15.015842 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 570/1122] 10.222.0.64 () {58 vars in 1272 bytes} [Tue Oct 4 14:37:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1397666128 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:37:15.298115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:15.298755 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:15.319789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:15.320163 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:15.320655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:15.321625 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:15.323214 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:15.323214 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:15.528575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:15.537805 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:15.539250 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:15.540532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a5d3fbed-3d6c-4380-b736-6d7b669c08b5 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1718 microversion: 2.20 time: 0.255914 Oct 04 14:37:15.541084 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 553/1123] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:15 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:17.979635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-53431428-088b-43c1-826a-25616dee1c07 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Action: 'create', calling method: .version_select at 0x7f5718630430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1767417928", "metadata": {"Type": "work"}}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-53431428-088b-43c1-826a-25616dee1c07 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Request method failure captured: Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 122 Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEUd6KQFOibqm_8Km0jmkEBtehNyhjsewYczyaFe2CNJvCL4uAgk9NU1KDfOclpvNO0Y_0TDUvzVsrlAoHkDEjXDHde23qm2MdnAMyoaHAbGqi5F74QTfTPb_PqpZHCVjC6NoKV_afiWf_i6OnPZmLQLt9s7_iVRcz6BTuSIy2q9_s8 Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:17.997145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_abcfbd90111d4648b1a2a668bb58912b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fdf14ee6f8614addb2a799b45c6a4f6f Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1767417928", "metadata": {"Type": "work"}}} Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:37:17.998866 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1767417928', 'metadata': {'Type': 'work'}}}} Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise error Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:17.999865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 14:37:18.002251 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 14:37:18.003459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 14:37:18.003459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.003459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-53431428-088b-43c1-826a-25616dee1c07 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:18.003459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-53431428-088b-43c1-826a-25616dee1c07 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.168063 Oct 04 14:37:18.003459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 571/1124] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Oct 4 14:37:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:37:18.011630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e7163b28-e5a3-4eff-87f3-eeeddf202f6b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Action: 'create', calling method: .version_select at 0x7f57186c6c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-925397829", "metadata": {"Type": "work"}}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e7163b28-e5a3-4eff-87f3-eeeddf202f6b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Request method failure captured: Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 119 Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEUd6KQFOibqm_8Km0jmkEBtehNyhjsewYczyaFe2CNJvCL4uAgk9NU1KDfOclpvNO0Y_0TDUvzVsrlAoHkDEjXDHde23qm2MdnAMyoaHAbGqi5F74QTfTPb_PqpZHCVjC6NoKV_afiWf_i6OnPZmLQLt9s7_iVRcz6BTuSIy2q9_s8 Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:18.016509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_abcfbd90111d4648b1a2a668bb58912b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: fdf14ee6f8614addb2a799b45c6a4f6f Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-925397829", "metadata": {"Type": "work"}}} Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: Oct 04 14:37:18.018177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-925397829', 'metadata': {'Type': 'work'}}}} Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise error Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi '0' Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:18.019194 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 14:37:18.021133 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 14:37:18.022541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 14:37:18.022541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.022541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e7163b28-e5a3-4eff-87f3-eeeddf202f6b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:18.022960 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e7163b28-e5a3-4eff-87f3-eeeddf202f6b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013850 Oct 04 14:37:18.023874 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 554/1125] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Oct 4 14:37:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:37:18.037313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9225bc64-12f1-446e-9450-e728f1365e10 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Action: 'create', calling method: .version_select at 0x7f5718630dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1540948190", "metadata": {"Type": "work"}}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9225bc64-12f1-446e-9450-e728f1365e10 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Request method failure captured: Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 119 Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEUd6KQFOibqm_8Km0jmkEBtehNyhjsewYczyaFe2CNJvCL4uAgk9NU1KDfOclpvNO0Y_0TDUvzVsrlAoHkDEjXDHde23qm2MdnAMyoaHAbGqi5F74QTfTPb_PqpZHCVjC6NoKV_afiWf_i6OnPZmLQLt9s7_iVRcz6BTuSIy2q9_s8 Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:18.041698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_abcfbd90111d4648b1a2a668bb58912b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fdf14ee6f8614addb2a799b45c6a4f6f Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1540948190", "metadata": {"Type": "work"}}} Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:37:18.043327 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1540948190', 'metadata': {'Type': 'work'}}}} Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise error Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi '' Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:18.045332 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 14:37:18.046865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 14:37:18.048209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 14:37:18.048209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.048209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-9225bc64-12f1-446e-9450-e728f1365e10 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:18.048209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-9225bc64-12f1-446e-9450-e728f1365e10 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012336 Oct 04 14:37:18.048209 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 572/1126] 10.222.0.64 () {60 vars in 1156 bytes} [Tue Oct 4 14:37:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:37:18.056265 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-178117eb-0423-4561-92bd-370cb4996a8b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Calling method '.version_select at 0x7f5718acd940>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:18.091142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-178117eb-0423-4561-92bd-370cb4996a8b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] HTTP exception thrown: Volume tempest-invalid-1106960237 could not be found. Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-178117eb-0423-4561-92bd-370cb4996a8b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Request method failure captured: Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1106960237 HTTP/1.1 Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEUd6KQFOibqm_8Km0jmkEBtehNyhjsewYczyaFe2CNJvCL4uAgk9NU1KDfOclpvNO0Y_0TDUvzVsrlAoHkDEjXDHde23qm2MdnAMyoaHAbGqi5F74QTfTPb_PqpZHCVjC6NoKV_afiWf_i6OnPZmLQLt9s7_iVRcz6BTuSIy2q9_s8 Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:18.093348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_abcfbd90111d4648b1a2a668bb58912b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: fdf14ee6f8614addb2a799b45c6a4f6f Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Volume tempest-invalid-1106960237 could not be found. Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': 'tempest-invalid-1106960237'} Oct 04 14:37:18.094733 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1106960237 could not be found. (HTTP 404) (Request-ID: req-47ef2cea-d7ad-41d5-92bf-9f637ec1d990) Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.095595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 14:37:18.096851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1106960237 could not be found. Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:18.098097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1106960237 could not be found. Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1106960237 could not be found. Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-178117eb-0423-4561-92bd-370cb4996a8b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Returning 404 to user: Volume tempest-invalid-1106960237 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-178117eb-0423-4561-92bd-370cb4996a8b tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1106960237" status: 404 len: 99 microversion: 2.1 time: 0.044206 Oct 04 14:37:18.099329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 555/1127] 10.222.0.64 () {58 vars in 1218 bytes} [Tue Oct 4 14:37:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1106960237 => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 14:37:18.105441 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-31bf483f-a697-4158-8b28-03206c351481 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004552 Oct 04 14:37:18.105955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 573/1128] 10.222.0.64 () {58 vars in 1140 bytes} [Tue Oct 4 14:37:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 14:37:18.115014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2fc99f2e-19ed-4347-89c6-56f9473caab8 tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003886 Oct 04 14:37:18.116570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 556/1129] 10.222.0.64 () {58 vars in 1137 bytes} [Tue Oct 4 14:37:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 14:37:18.128096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aabc4b8e-1631-4b1b-b964-d8ae8c00e4be tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Calling method '.version_select at 0x7f5718646dc0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:18.162325 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-aabc4b8e-1631-4b1b-b964-d8ae8c00e4be tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] HTTP exception thrown: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aabc4b8e-1631-4b1b-b964-d8ae8c00e4be tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Request method failure captured: Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: DELETE /compute/v2.1/os-volumes/c9e0d9f9-7391-48cd-9b41-213537a61c2f HTTP/1.1 Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEUd6KQFOibqm_8Km0jmkEBtehNyhjsewYczyaFe2CNJvCL4uAgk9NU1KDfOclpvNO0Y_0TDUvzVsrlAoHkDEjXDHde23qm2MdnAMyoaHAbGqi5F74QTfTPb_PqpZHCVjC6NoKV_afiWf_i6OnPZmLQLt9s7_iVRcz6BTuSIy2q9_s8 Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:18.171901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_abcfbd90111d4648b1a2a668bb58912b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: fdf14ee6f8614addb2a799b45c6a4f6f Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'c9e0d9f9-7391-48cd-9b41-213537a61c2f'} Oct 04 14:37:18.173559 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. (HTTP 404) (Request-ID: req-50855b9c-97fe-43ab-ad6d-4b36a45404cc) Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.174533 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 14:37:18.176170 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 14:37:18.177384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aabc4b8e-1631-4b1b-b964-d8ae8c00e4be tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Returning 404 to user: Volume c9e0d9f9-7391-48cd-9b41-213537a61c2f could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aabc4b8e-1631-4b1b-b964-d8ae8c00e4be tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/c9e0d9f9-7391-48cd-9b41-213537a61c2f" status: 404 len: 109 microversion: 2.1 time: 0.049937 Oct 04 14:37:18.178687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 574/1130] 10.222.0.64 () {58 vars in 1248 bytes} [Tue Oct 4 14:37:18 2022] DELETE /compute/v2.1/os-volumes/c9e0d9f9-7391-48cd-9b41-213537a61c2f => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:18.189574 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cd1fe2b5-158e-4174-81cd-eaeb27d369cf tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Calling method '.version_select at 0x7f5718661280>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:18.220851 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-cd1fe2b5-158e-4174-81cd-eaeb27d369cf tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] HTTP exception thrown: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cd1fe2b5-158e-4174-81cd-eaeb27d369cf tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Request method failure captured: Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/os-volumes/222b3564-907b-4da6-b7d9-7f643b83811c HTTP/1.1 Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEUd6KQFOibqm_8Km0jmkEBtehNyhjsewYczyaFe2CNJvCL4uAgk9NU1KDfOclpvNO0Y_0TDUvzVsrlAoHkDEjXDHde23qm2MdnAMyoaHAbGqi5F74QTfTPb_PqpZHCVjC6NoKV_afiWf_i6OnPZmLQLt9s7_iVRcz6BTuSIy2q9_s8 Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:18.223085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_abcfbd90111d4648b1a2a668bb58912b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/abcfbd90111d4648b1a2a668bb58912b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: abcfbd90111d4648b1a2a668bb58912b Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-VolumesNegativeTest-1378879345 Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: fdf14ee6f8614addb2a799b45c6a4f6f Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-VolumesNegativeTest-1378879345-project Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '222b3564-907b-4da6-b7d9-7f643b83811c'} Oct 04 14:37:18.225049 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. (HTTP 404) (Request-ID: req-fa33adce-512d-4a99-bd54-2156da442c42) Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.226264 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 14:37:18.227847 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 14:37:18.229278 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-cd1fe2b5-158e-4174-81cd-eaeb27d369cf tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] Returning 404 to user: Volume 222b3564-907b-4da6-b7d9-7f643b83811c could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:18.230623 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-cd1fe2b5-158e-4174-81cd-eaeb27d369cf tempest-VolumesNegativeTest-1378879345 tempest-VolumesNegativeTest-1378879345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/222b3564-907b-4da6-b7d9-7f643b83811c" status: 404 len: 109 microversion: 2.1 time: 0.043048 Oct 04 14:37:18.232530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 557/1131] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:37:18 2022] GET /compute/v2.1/os-volumes/222b3564-907b-4da6-b7d9-7f643b83811c => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:18.645619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3837a4d-5467-47be-b498-444a23edc0d6"}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:18.655304 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:18.662440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:18.663066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:18.663599 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:18.664515 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:18.665147 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:18.665658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:18.682524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:19.101806 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-208c0b60-f59d-4336-ac66-02a74f330d88 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "POST /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461652 Oct 04 14:37:19.103546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 575/1132] 10.222.0.64 () {60 vars in 1323 bytes} [Tue Oct 4 14:37:18 2022] POST /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:27.050474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:27.051343 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:27.059001 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:27.059771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=26 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:27.084633 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:27.085236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:27.085636 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:27.086710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:27.087176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:27.087606 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:27.237148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'services' on Instance uuid a960e16e-2d9b-4ad0-95c8-d1b951f4a29f {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:27.363231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-29010cba-43bd-4630-b657-2297fed264dc tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments/c3837a4d-5467-47be-b498-444a23edc0d6" status: 202 len: 0 microversion: 2.1 time: 0.317718 Oct 04 14:37:27.365179 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 558/1133] 10.222.0.64 () {58 vars in 1416 bytes} [Tue Oct 4 14:37:27 2022] DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments/c3837a4d-5467-47be-b498-444a23edc0d6 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:37:27.383926 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:27.390742 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:27.401992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:27.404063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:27.404865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:27.407063 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:27.407907 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:27.408762 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:27.452196 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-fe984821-6f82-4585-9212-09c5e7390491 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075582 Oct 04 14:37:27.453446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 576/1134] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:27 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:37:28.465785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:28.468294 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:28.475146 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:28.475630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:28.476094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:28.477168 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:28.477799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:28.478388 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:28.511720 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4bbfc9e3-f4bb-4b46-b7c2-48f38e13c76a tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050906 Oct 04 14:37:28.512646 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 559/1135] 10.222.0.64 () {58 vars in 1302 bytes} [Tue Oct 4 14:37:28 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 14:37:28.591698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:28.592335 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:28.600844 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:28.601444 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:28.603296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:28.604033 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:28.604518 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:28.604967 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:28.635524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:37:28.764081 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-25c4e619-a49e-4d31-b163-44fa0c591c65 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 204 len: 0 microversion: 2.1 time: 0.173881 Oct 04 14:37:28.766634 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 577/1136] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:28 2022] DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:37:28.777067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:28.777722 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:28.785714 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:28.787138 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:28.787765 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:28.793116 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:28.794668 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:28.797782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:29.025615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:29.039763 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b5ba22c7-1c5b-48a3-aa1b-28f4eceb884c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1681 microversion: 2.1 time: 0.264556 Oct 04 14:37:29.040437 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 560/1137] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:28 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:37:30.068104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:30.071166 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:30.084698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:30.086216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:30.087804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:30.088859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:30.091971 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:30.093630 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:30.359086 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:30.367508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-256f04c7-2eb3-4b53-a84a-390b906a649d tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1681 microversion: 2.1 time: 0.306415 Oct 04 14:37:30.368092 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 578/1138] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:30 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:31.391741 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:31.393217 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:31.411035 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:31.413196 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:31.414618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:31.417893 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:31.418566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:31.422068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:31.644541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:31.655951 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-02061251-e4ce-4110-bb9a-e657d68590f9 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1614 microversion: 2.1 time: 0.268230 Oct 04 14:37:31.661794 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 561/1139] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:31 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1614 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:32.033593 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-d3d7d01f-f316-4489-b369-71af4190208e req-0a038f7e-03a4-4d81-a6f9-d7aecf5abe84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a960e16e-2d9b-4ad0-95c8-d1b951f4a29f", "name": "network-vif-deleted", "tag": "c36c3311-21de-407e-a97a-632316d80eb7"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:32.081285 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d3d7d01f-f316-4489-b369-71af4190208e req-0a038f7e-03a4-4d81-a6f9-d7aecf5abe84 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:32.082710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d3d7d01f-f316-4489-b369-71af4190208e req-0a038f7e-03a4-4d81-a6f9-d7aecf5abe84 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:32.083278 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d3d7d01f-f316-4489-b369-71af4190208e req-0a038f7e-03a4-4d81-a6f9-d7aecf5abe84 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:32.116437 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-d3d7d01f-f316-4489-b369-71af4190208e req-0a038f7e-03a4-4d81-a6f9-d7aecf5abe84 service nova] Creating event network-vif-deleted:c36c3311-21de-407e-a97a-632316d80eb7 for instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f on hv-cinder-86026 Oct 04 14:37:32.130858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-d3d7d01f-f316-4489-b369-71af4190208e req-0a038f7e-03a4-4d81-a6f9-d7aecf5abe84 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106337 Oct 04 14:37:32.132715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 579/1140] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:32.687609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:32.689027 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:32.697841 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:32.698547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:32.699434 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:32.700517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:32.701174 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:32.701919 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:32.768609 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:32.769386 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:32.769835 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:32.770303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.objects.instance [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lazy-loading 'fault' on Instance uuid a960e16e-2d9b-4ad0-95c8-d1b951f4a29f {{(pid=120820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:37:32.856885 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54b3856eb61a487dab21d8ffa345701c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5731dbee8946a281caefaeb02bd7ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:32.870432 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-da9c992d-0766-44d5-8442-0d5c8a676b38 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 200 len: 1332 microversion: 2.1 time: 0.187258 Oct 04 14:37:32.873756 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 562/1141] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:32 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 1332 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:33.907644 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:33.910818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:33.924272 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:33.925188 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:33.925859 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:33.926809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:33.927749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:33.928420 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:33.948263 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f HTTP/1.1 Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:33.951151 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:33.955794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'a960e16e-2d9b-4ad0-95c8-d1b951f4a29f'} Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:33.956769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:33.958112 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:33.959281 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:33.959281 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-eba16025-8387-49c9-b016-0b4b6f4475aa tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 404 len: 111 microversion: 2.1 time: 0.061959 Oct 04 14:37:33.967370 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 580/1142] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:33 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:33.972955 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d6446c1c-df8f-4842-9d98-203d56503ad1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '.version_select at 0x7f57186bd4c0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:34.033785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d6446c1c-df8f-4842-9d98-203d56503ad1 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502087991" status: 202 len: 0 microversion: 2.1 time: 0.064566 Oct 04 14:37:34.036651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 563/1143] 10.222.0.64 () {58 vars in 1221 bytes} [Tue Oct 4 14:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502087991 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:37:36.297354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:36.297919 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:36.307269 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:36.307774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:36.308214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:36.311823 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:36.312361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:36.312800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:36.346751 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f HTTP/1.1 Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:36.350061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.351668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'a960e16e-2d9b-4ad0-95c8-d1b951f4a29f'} Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:36.352478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.353725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.355015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:36.355015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-af545785-cccb-4a22-9c85-1ef62fece0ac tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 404 len: 111 microversion: 2.1 time: 0.062719 Oct 04 14:37:36.355015 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 581/1144] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:36 2022] DELETE /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:36.362592 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:36.363321 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: a960e16e-2d9b-4ad0-95c8-d1b951f4a29f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:36.380532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:36.382526 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:36.383507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:36.384737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:36.391543 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:36.392527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:36.411410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f HTTP/1.1 Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:36.417742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.419377 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': 'a960e16e-2d9b-4ad0-95c8-d1b951f4a29f'} Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:36.420165 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. Oct 04 14:37:36.421446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:36.423886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance a960e16e-2d9b-4ad0-95c8-d1b951f4a29f could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:36.424976 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c556fba6-f291-46b1-9093-6caa2c457adf tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f" status: 404 len: 111 microversion: 2.1 time: 0.066827 Oct 04 14:37:36.429654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 564/1145] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:36 2022] GET /compute/v2.1/servers/a960e16e-2d9b-4ad0-95c8-d1b951f4a29f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:37.706726 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:37.707463 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:37.724957 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.728796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.729368 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.733449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.734126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.734589 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.770782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed HTTP/1.1 Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:37.790873 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.792853 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '1cd13e9a-f9e0-49d8-b173-d65efded21ed'} Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:37.793855 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.795614 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.803216 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:37.807650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c142189e-5e92-45eb-8dbc-8c2ef8fcff44 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 404 len: 111 microversion: 2.1 time: 0.107336 Oct 04 14:37:37.807650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 582/1146] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:37 2022] DELETE /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:37.816456 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:37.817922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 1cd13e9a-f9e0-49d8-b173-d65efded21ed] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:37.832499 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.835893 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.836822 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.837881 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.838529 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.840915 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.874991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed HTTP/1.1 Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:37.876652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.878384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '1cd13e9a-f9e0-49d8-b173-d65efded21ed'} Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:37.879336 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. Oct 04 14:37:37.881091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.882621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 1cd13e9a-f9e0-49d8-b173-d65efded21ed could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:37.882621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9b1e946f-1125-456e-bd5e-af5a52c51e6c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed" status: 404 len: 111 microversion: 2.1 time: 0.066354 Oct 04 14:37:37.891409 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 565/1147] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:37 2022] GET /compute/v2.1/servers/1cd13e9a-f9e0-49d8-b173-d65efded21ed => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:37.903929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:37.904486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:37.912738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.914522 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.915679 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.916631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.917359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.917981 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.934955 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: DELETE /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f HTTP/1.1 Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:37:37.936699 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.938407 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '08e321c8-c06c-4113-a76d-21aa1a27946f'} Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:37.939367 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.941144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.943928 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:37.945258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-64c8832d-7d75-4d87-96d9-d24865ec917e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 404 len: 111 microversion: 2.1 time: 0.053541 Oct 04 14:37:37.946242 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 583/1148] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:37 2022] DELETE /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:37.956118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:37.956860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 08e321c8-c06c-4113-a76d-21aa1a27946f] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:37.966584 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.967029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.967473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.968202 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:37.968693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:37.969121 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:37.992622 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f HTTP/1.1 Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:37.996762 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.998774 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '08e321c8-c06c-4113-a76d-21aa1a27946f'} Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:37.999941 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. Oct 04 14:37:38.001544 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:38.006372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 08e321c8-c06c-4113-a76d-21aa1a27946f could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:38.008577 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f96dbac9-d4e9-47dc-a69b-c9240caa3b7c tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f" status: 404 len: 111 microversion: 2.1 time: 0.058155 Oct 04 14:37:38.013603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 566/1149] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:37 2022] GET /compute/v2.1/servers/08e321c8-c06c-4113-a76d-21aa1a27946f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:39.197174 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:39.198682 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:39.208725 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:39.211346 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:39.212472 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:39.213679 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:39.214371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:39.215384 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:39.240407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 HTTP/1.1 Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:39.244162 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.245939 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '92da7788-17c4-4129-b353-b25576213350'} Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:39.246833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.251691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.253298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:39.253298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ad2d01c5-715e-4f85-986f-e8ab08116d6e tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 404 len: 111 microversion: 2.1 time: 0.053019 Oct 04 14:37:39.253298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 567/1150] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:37:39 2022] DELETE /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:39.260327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:39.260964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] [instance: 92da7788-17c4-4129-b353-b25576213350] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:39.268984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:39.269760 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:39.271431 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:39.273811 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:39.274883 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:39.275952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:39.323908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] HTTP exception thrown: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Request method failure captured: Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 HTTP/1.1 Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENae8ThvLk3htUBUkUIcvQ5SQjwmZyT9LlVKu1p84f9OwSs-AQ99Kq6UIW5GU71gIwszSI-yx5KhJvnBT_v5NOqyrKL_VzdNAnO2VwR2ma6I9TBgVEWGfjcjZZ6jIUP7iVsmxC3dSMh3SU4SO_NfQxbzPvhk5FYMxBa73Eq18kVbpY Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:39.327950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e5731dbee8946a281caefaeb02bd7ff", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e5731dbee8946a281caefaeb02bd7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 1e5731dbee8946a281caefaeb02bd7ff Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1316177622 Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 54b3856eb61a487dab21d8ffa345701c Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeNegativeTest-1316177622-project Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.329659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '92da7788-17c4-4129-b353-b25576213350'} Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:39.330607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. Oct 04 14:37:39.332113 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:39.336541 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] Returning 404 to user: Instance 92da7788-17c4-4129-b353-b25576213350 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:39.340350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3eafa0a6-3e4e-4aa2-b6ef-136dcf355b23 tempest-AttachVolumeNegativeTest-1316177622 tempest-AttachVolumeNegativeTest-1316177622-project] 10.222.0.64 "GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350" status: 404 len: 111 microversion: 2.1 time: 0.086556 Oct 04 14:37:39.341539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 568/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:39 2022] GET /compute/v2.1/servers/92da7788-17c4-4129-b353-b25576213350 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:37:39.503839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-dc58bef6-3616-40ec-bb66-b70bfe307b8b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Action: 'create', calling method: .version_select at 0x7f5718646dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1583935714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8sxH01sI2YsGBmMdaCU6ypiIQQAiFuFlxg0pXCvwl+BPlYDI83zRoFh5NDJvB8MNeNkpYeMeJySc3AfVFsNUokrTOXAGa8DinJNL72uGH18KWIYQ77EJXenneNtdBMsw=="}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:39.521572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-dc58bef6-3616-40ec-bb66-b70bfe307b8b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Getting quotas for project bf0ffb6098014feb89d5d6f61832b03b. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:37:39.526548 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.quota [None req-dc58bef6-3616-40ec-bb66-b70bfe307b8b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Getting quotas for user 33fb70b5ab4942a38771709eeb3a5789 and project bf0ffb6098014feb89d5d6f61832b03b. Resources: {'key_pairs'} {{(pid=120821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:37:39.562598 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-dc58bef6-3616-40ec-bb66-b70bfe307b8b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.540284 Oct 04 14:37:39.575034 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 584/1152] 10.222.0.64 () {60 vars in 1159 bytes} [Tue Oct 4 14:37:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:48.379659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-99614758", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1694566594", "security_groups": [{"name": "tempest-secgroup-smoke-2039710880"}], "block_device_mapping_v2": [{"uuid": "75fdbac5-cabd-4148-99cb-5738a63c8ae0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4116101e-9cfb-4512-a759-154f86437ec3"}]}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:48.508699 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] validate_networks() for [('4116101e-9cfb-4512-a759-154f86437ec3', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:37:48.909931 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:37:48.910368 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:37:48.910843 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:37:48.911254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:37:48.911672 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:37:48.922352 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:48.922860 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:48.923291 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:48.924053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:48.924542 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:48.924991 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:48.942913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for project 408b16a582484c619ff17416990d5feb. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:37:48.947666 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Getting quotas for user c7028d2ccede4b44b567387bb83c4579 and project 408b16a582484c619ff17416990d5feb. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:37:49.010484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:37:49.012905 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='75fdbac5-cabd-4148-99cb-5738a63c8ae0',volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:37:49.159203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0bc620c7-61f8-43b9-8d3f-dae19f657f66 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783400 Oct 04 14:37:49.160380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 569/1153] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:37:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 14:37:49.172604 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-380bfcaa-b636-43b2-bbec-486d5bc44cde tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:49.173541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-380bfcaa-b636-43b2-bbec-486d5bc44cde tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:49.175570 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:49.176653 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:49.256161 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-380bfcaa-b636-43b2-bbec-486d5bc44cde tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:49.265122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-380bfcaa-b636-43b2-bbec-486d5bc44cde tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1093 microversion: 2.1 time: 0.096518 Oct 04 14:37:49.265689 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 585/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:49 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:50.301446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:50.302068 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:50.309467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:50.310484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:50.311115 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:50.311986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:50.312711 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:50.313287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:50.395992 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:50.406316 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-12b3e2f2-d70d-4d78-871b-4207e4056ecc tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1191 microversion: 2.1 time: 0.119160 Oct 04 14:37:50.407013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 570/1155] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:50 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:37:51.433167 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:51.434525 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:51.444715 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:51.445765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:51.446431 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:51.447402 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:51.448098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:51.449543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:51.564673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:51.575376 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8a84606e-6870-4c6f-af23-e32568ab0973 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1209 microversion: 2.1 time: 0.149072 Oct 04 14:37:51.589215 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 586/1156] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:51 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:52.560482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-a763c4d6-6da9-4918-b523-a0adcf7cf11a req-d7af02b9-884e-421c-8f0a-be14a80d78e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2e7361-695d-4c7d-8116-00182e81496d", "tag": "80793cb0-42ec-49e9-9b78-9c29012762c0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:52.571364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-a763c4d6-6da9-4918-b523-a0adcf7cf11a req-d7af02b9-884e-421c-8f0a-be14a80d78e0 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:52.571723 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-a763c4d6-6da9-4918-b523-a0adcf7cf11a req-d7af02b9-884e-421c-8f0a-be14a80d78e0 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:52.572204 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-a763c4d6-6da9-4918-b523-a0adcf7cf11a req-d7af02b9-884e-421c-8f0a-be14a80d78e0 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:52.589092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-a763c4d6-6da9-4918-b523-a0adcf7cf11a req-d7af02b9-884e-421c-8f0a-be14a80d78e0 service nova] Creating event network-changed:80793cb0-42ec-49e9-9b78-9c29012762c0 for instance ba2e7361-695d-4c7d-8116-00182e81496d on hv-cinder-86026 Oct 04 14:37:52.596749 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-a763c4d6-6da9-4918-b523-a0adcf7cf11a req-d7af02b9-884e-421c-8f0a-be14a80d78e0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039724 Oct 04 14:37:52.597522 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 571/1157] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:37:52.603550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:52.607615 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:52.615191 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:52.617077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:52.617480 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:52.618255 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:52.619134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:52.619738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:52.809531 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:52.819061 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-05ffbf69-6624-48e6-826b-852e46ddc221 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.223753 Oct 04 14:37:52.819671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 587/1158] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:52 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:53.843489 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:53.845077 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:53.857286 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:53.857781 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:53.858221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:53.858948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:53.859484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:53.859943 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.083450 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:54.097964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-743b69eb-477f-46ea-877f-71377d56bdac tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.258559 Oct 04 14:37:54.113737 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 572/1159] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:53 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:54.207106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:54.210283 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:54.217041 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:54.217526 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:54.217954 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.218662 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:54.219105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:54.219543 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.250737 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-17f8b1d9-0cc5-436d-aa2e-693dfde61638 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047562 Oct 04 14:37:54.251979 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 588/1160] 10.222.0.64 () {60 vars in 1343 bytes} [Tue Oct 4 14:37:54 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:54.322513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:54.323009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:54.329867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:54.330348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:54.330789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.331530 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:54.331981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:54.332421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.359667 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:37:54.445477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-aacc1073-461a-4eeb-ba7b-65de0e0b4ad1 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 204 len: 0 microversion: 2.20 time: 0.127303 Oct 04 14:37:54.446261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 573/1161] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Oct 4 14:37:54 2022] DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 14:37:54.459923 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:54.460088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:54.468001 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:54.468903 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:54.469343 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.470055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:54.470521 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:54.470933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:54.639010 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:54.648466 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:54.649932 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:54.651126 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-90682dd0-7be2-4ed6-a88b-f56a93a51a09 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.196813 Oct 04 14:37:54.651965 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 589/1162] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:54 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:55.126067 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:55.126869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:55.133765 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:55.134347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:55.134846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:55.135576 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:55.135940 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:55.136452 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:55.329790 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:55.338430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-94531b21-173b-43fc-8e96-417355a1c6c7 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.216516 Oct 04 14:37:55.339347 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 574/1163] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:55 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:55.686013 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:55.686713 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:55.695671 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:55.696324 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:55.696902 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:55.697794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:55.698252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:55.698872 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:55.903741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:55.913725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:55.915675 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:55.917101 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-c82e4798-6d5e-48a4-b292-b1426a249818 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1724 microversion: 2.20 time: 0.235381 Oct 04 14:37:55.918385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 590/1164] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:55 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:56.366824 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:56.368118 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:56.379256 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:56.380105 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:56.380839 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:56.382106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:56.382738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:56.383353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:56.647248 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:56.657868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-38bc3083-6dfb-4cd2-aa5a-e99487a9f9ce tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.297554 Oct 04 14:37:56.658492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 575/1165] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:56 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:56.945123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:56.945857 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:56.952793 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:56.953269 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:56.953703 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:56.954424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:56.954849 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:56.955271 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:57.049072 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:57.063329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:57.064804 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c5b38375d6ff4d0db0f3f7bc89ca8798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64993786e21b45beb7829ceaede4777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:57.067539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-ceabb6d4-7b5d-4b8b-a743-4f36ca896cb2 req-df02ac42-7047-46e0-bff4-f35f3984c5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bb7e73-d6ea-4441-8b64-19affd0804f6", "name": "network-vif-deleted", "tag": "43d8d357-7ddb-4b57-8267-bb0fba101087"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:37:57.071600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a9655feb-b973-40c5-b536-10cb480e4dab tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 200 len: 1656 microversion: 2.20 time: 0.131252 Oct 04 14:37:57.072190 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 591/1166] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:56 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 1656 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 14:37:57.081395 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-ceabb6d4-7b5d-4b8b-a743-4f36ca896cb2 req-df02ac42-7047-46e0-bff4-f35f3984c5a8 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:57.088594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-ceabb6d4-7b5d-4b8b-a743-4f36ca896cb2 req-df02ac42-7047-46e0-bff4-f35f3984c5a8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:57.088594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-ceabb6d4-7b5d-4b8b-a743-4f36ca896cb2 req-df02ac42-7047-46e0-bff4-f35f3984c5a8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:57.093366 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:57.120788 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-ceabb6d4-7b5d-4b8b-a743-4f36ca896cb2 req-df02ac42-7047-46e0-bff4-f35f3984c5a8 service nova] Creating event network-vif-deleted:43d8d357-7ddb-4b57-8267-bb0fba101087 for instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 on hv-cinder-86026 Oct 04 14:37:57.127580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-ceabb6d4-7b5d-4b8b-a743-4f36ca896cb2 req-df02ac42-7047-46e0-bff4-f35f3984c5a8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063199 Oct 04 14:37:57.133277 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 576/1167] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:37:57.681494 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:57.682347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:57.689202 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:57.689698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:57.690134 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:57.690839 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:57.691293 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:57.692181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:57.871643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:57.891397 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-74da3930-e9f9-4e0b-a370-3fea8d257df6 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.213959 Oct 04 14:37:57.892393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 592/1168] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:57 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:37:58.101731 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:58.102433 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:58.106065 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:58.114498 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:58.114986 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:58.116494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:58.118422 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:58.119063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:58.119570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:58.139836 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] HTTP exception thrown: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Request method failure captured: Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 HTTP/1.1 Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENgJ70YnIadHTqiCjhsslkU0jj2WY2RzIdTNIzfcnsr7swqjUY4YRUvAmKXi5gOYoDPw2S_lxwclaqe87wQOFnAeO-DK3UTqDkB8J0BkLpzV88YPlZuFE66-5PTOBUIGtDQzDAkSXbuIrtkY8x8C1mvoB83dSP14nl7zqD4ZKfGJVk Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:37:58.143632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64993786e21b45beb7829ceaede4777a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64993786e21b45beb7829ceaede4777a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: c5b38375d6ff4d0db0f3f7bc89ca8798 Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:37:58.145567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '35bb7e73-d6ea-4441-8b64-19affd0804f6'} Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:37:58.146351 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:37:58.147812 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:37:58.149004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Returning 404 to user: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:37:58.149004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5151bf1b-7455-437a-9301-0c3fd6f017fe tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 404 len: 111 microversion: 2.20 time: 0.050043 Oct 04 14:37:58.150719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 577/1169] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:37:58 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:37:58.159118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0dfc362c-9540-4ef1-a6f2-b9a4bd2fc0b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '.version_select at 0x7f571bf50dc0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:58.182186 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0dfc362c-9540-4ef1-a6f2-b9a4bd2fc0b6 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367836450" status: 204 len: 0 microversion: 2.20 time: 0.029673 Oct 04 14:37:58.182890 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 593/1170] 10.222.0.64 () {60 vars in 1262 bytes} [Tue Oct 4 14:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367836450 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 14:37:58.920207 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:37:58.920876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:37:58.928701 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:58.929187 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:58.929729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:58.930842 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:37:58.931411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:37:58.931948 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:37:58.936424 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:58.955524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=6 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:37:59.086659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:37:59.094721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-6ed7b980-75b0-4635-8343-034e2cb3d0fe tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.180249 Oct 04 14:37:59.095334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 578/1171] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:37:58 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:00.029555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=6 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:00.033572 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:00.034066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:00.042019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.042506 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.042946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.043650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.044104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.044554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.058800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] HTTP exception thrown: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Request method failure captured: Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 HTTP/1.1 Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPENgJ70YnIadHTqiCjhsslkU0jj2WY2RzIdTNIzfcnsr7swqjUY4YRUvAmKXi5gOYoDPw2S_lxwclaqe87wQOFnAeO-DK3UTqDkB8J0BkLpzV88YPlZuFE66-5PTOBUIGtDQzDAkSXbuIrtkY8x8C1mvoB83dSP14nl7zqD4ZKfGJVk Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:38:00.060434 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64993786e21b45beb7829ceaede4777a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64993786e21b45beb7829ceaede4777a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: c5b38375d6ff4d0db0f3f7bc89ca8798 Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.062016 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': '35bb7e73-d6ea-4441-8b64-19affd0804f6'} Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:38:00.063046 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.064361 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.065681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Returning 404 to user: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:38:00.065681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e2d34098-7608-4ff4-a5c1-59bce7060368 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 404 len: 111 microversion: 2.20 time: 0.034267 Oct 04 14:38:00.065681 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 594/1172] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Oct 4 14:38:00 2022] DELETE /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:38:00.074789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:00.075412 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 35bb7e73-d6ea-4441-8b64-19affd0804f6] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:00.081818 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.082304 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.082741 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.083445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.084518 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.084993 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.098819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] HTTP exception thrown: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Request method failure captured: Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 HTTP/1.1 Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENgJ70YnIadHTqiCjhsslkU0jj2WY2RzIdTNIzfcnsr7swqjUY4YRUvAmKXi5gOYoDPw2S_lxwclaqe87wQOFnAeO-DK3UTqDkB8J0BkLpzV88YPlZuFE66-5PTOBUIGtDQzDAkSXbuIrtkY8x8C1mvoB83dSP14nl7zqD4ZKfGJVk Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:38:00.100652 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64993786e21b45beb7829ceaede4777a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64993786e21b45beb7829ceaede4777a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: c5b38375d6ff4d0db0f3f7bc89ca8798 Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.102091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '35bb7e73-d6ea-4441-8b64-19affd0804f6'} Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:38:00.103301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. Oct 04 14:38:00.104944 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:00.106604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Returning 404 to user: Instance 35bb7e73-d6ea-4441-8b64-19affd0804f6 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:38:00.106604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e987fab1-345a-4921-b1d9-abe529f345a4 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6" status: 404 len: 111 microversion: 2.20 time: 0.031164 Oct 04 14:38:00.106604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 579/1173] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:38:00 2022] GET /compute/v2.1/servers/35bb7e73-d6ea-4441-8b64-19affd0804f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:38:00.118750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:00.119512 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:00.126806 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.127273 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.127798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.128421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.128871 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.129290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.288798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:00.296563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0267650a-e30f-48a5-8812-2f8088044735 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.182331 Oct 04 14:38:00.297139 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 595/1174] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:00 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:00.401463 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1132707693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1583935714", "security_groups": [{"name": "tempest-secgroup-smoke-353837959"}], "networks": [{"uuid": "8dc4bbb0-f4de-40e9-996f-7b16b870c41f"}], "block_device_mapping_v2": [{"uuid": "f1d4a7fb-4f70-4585-a31b-c9e5cccaa44f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:38:00.543458 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.network.neutron [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] validate_networks() for [('8dc4bbb0-f4de-40e9-996f-7b16b870c41f', None, None, None, None, None)] {{(pid=120820) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 14:38:00.937483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Flavor limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 14:38:00.937906 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Image limits 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 14:38:00.938378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Flavor pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 14:38:00.938784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Image pref 0:0:0 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 14:38:00.939193 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.virt.hardware [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 14:38:00.948293 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.948930 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.949373 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.950110 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:00.950559 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:00.950980 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:00.969014 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Getting quotas for project bf0ffb6098014feb89d5d6f61832b03b. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 14:38:00.973350 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.quota [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Getting quotas for user 33fb70b5ab4942a38771709eeb3a5789 and project bf0ffb6098014feb89d5d6f61832b03b. Resources: {'instances', 'ram', 'cores'} {{(pid=120820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 14:38:01.034054 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Going to run 1 instances... {{(pid=120820) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 14:38:01.036288 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1d4a7fb-4f70-4585-a31b-c9e5cccaa44f',volume_size=None,volume_type=None)] {{(pid=120820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 14:38:01.178457 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-57a9f72d-1489-4176-903b-c402a332ebb5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780938 Oct 04 14:38:01.179112 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 580/1175] 10.222.0.64 () {60 vars in 1147 bytes} [Tue Oct 4 14:38:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 14:38:01.192351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0b6f39e6-9dd3-4956-90f7-4ed4570664c7 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:01.193256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0b6f39e6-9dd3-4956-90f7-4ed4570664c7 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:01.267253 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:01.267966 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:01.277002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:01.279145 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:01.280620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:01.281637 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:01.283465 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:01.283975 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:01.290619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0b6f39e6-9dd3-4956-90f7-4ed4570664c7 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:01.298098 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0b6f39e6-9dd3-4956-90f7-4ed4570664c7 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1089 microversion: 2.1 time: 0.111504 Oct 04 14:38:01.298672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 596/1176] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:01 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1089 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:01.307846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] HTTP exception thrown: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Request method failure captured: Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 HTTP/1.1 Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENgJ70YnIadHTqiCjhsslkU0jj2WY2RzIdTNIzfcnsr7swqjUY4YRUvAmKXi5gOYoDPw2S_lxwclaqe87wQOFnAeO-DK3UTqDkB8J0BkLpzV88YPlZuFE66-5PTOBUIGtDQzDAkSXbuIrtkY8x8C1mvoB83dSP14nl7zqD4ZKfGJVk Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:38:01.312984 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64993786e21b45beb7829ceaede4777a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64993786e21b45beb7829ceaede4777a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: c5b38375d6ff4d0db0f3f7bc89ca8798 Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.314600 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '128c7edb-5a5c-4f1c-b3cc-efc3b3a00677'} Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:38:01.315364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.317276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.319580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Returning 404 to user: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:38:01.319580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a17ecf56-e3b3-4183-9202-ab6f763b44bc tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 404 len: 111 microversion: 2.20 time: 0.053954 Oct 04 14:38:01.319580 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 581/1177] 10.222.0.64 () {60 vars in 1280 bytes} [Tue Oct 4 14:38:01 2022] DELETE /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 14:38:01.326206 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:01.326840 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:01.330961 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:01.334927 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:01.335114 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] [instance: 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:01.335408 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:01.336741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:01.337878 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:01.338920 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:01.339478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:01.347825 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:01.348358 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:01.348782 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:01.350175 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:01.351020 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:01.351784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:01.393442 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] HTTP exception thrown: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Request method failure captured: Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 HTTP/1.1 Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPENgJ70YnIadHTqiCjhsslkU0jj2WY2RzIdTNIzfcnsr7swqjUY4YRUvAmKXi5gOYoDPw2S_lxwclaqe87wQOFnAeO-DK3UTqDkB8J0BkLpzV88YPlZuFE66-5PTOBUIGtDQzDAkSXbuIrtkY8x8C1mvoB83dSP14nl7zqD4ZKfGJVk Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:38:01.395021 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64993786e21b45beb7829ceaede4777a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64993786e21b45beb7829ceaede4777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64993786e21b45beb7829ceaede4777a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 64993786e21b45beb7829ceaede4777a Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1402348381 Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: c5b38375d6ff4d0db0f3f7bc89ca8798 Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1402348381-project Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.396598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '128c7edb-5a5c-4f1c-b3cc-efc3b3a00677'} Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:38:01.397808 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. Oct 04 14:38:01.399079 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:38:01.400772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] Returning 404 to user: Instance 128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:38:01.400772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-8842318b-91d6-449f-981f-1d2e59c44912 tempest-AttachVolumeShelveTestJSON-1402348381 tempest-AttachVolumeShelveTestJSON-1402348381-project] 10.222.0.64 "GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677" status: 404 len: 111 microversion: 2.20 time: 0.074681 Oct 04 14:38:01.400772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 582/1178] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Oct 4 14:38:01 2022] GET /compute/v2.1/servers/128c7edb-5a5c-4f1c-b3cc-efc3b3a00677 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 14:38:01.567071 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:01.584995 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-454c1e04-df06-4bcd-b3d7-f6a9b217b746 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.262405 Oct 04 14:38:01.587623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 597/1179] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:01 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:02.323849 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:02.325203 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:02.332276 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:02.332853 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:02.333349 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:02.334898 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:02.335570 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:02.336221 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:02.444004 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:02.452789 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dfc53caf-2236-4170-9136-db1d15ba7d94 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1187 microversion: 2.1 time: 0.133204 Oct 04 14:38:02.453787 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 583/1180] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:02 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:02.610354 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:02.610962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:02.618113 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:02.618901 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:02.619547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:02.620517 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:02.621187 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:02.621684 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:02.822064 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:02.830392 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-8d35608c-4660-4cc4-a17e-a87643fd70a1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.224152 Oct 04 14:38:02.831326 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 598/1181] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:02 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:03.436655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-e4f760fe-1290-407f-864d-58ebb9b3f292 req-a6a44b34-523c-45f2-ace1-a3b1dd5c9680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2e7361-695d-4c7d-8116-00182e81496d", "name": "network-vif-plugged", "status": "completed", "tag": "80793cb0-42ec-49e9-9b78-9c29012762c0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:38:03.487469 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:03.488109 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:03.508695 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:03.508922 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e4f760fe-1290-407f-864d-58ebb9b3f292 req-a6a44b34-523c-45f2-ace1-a3b1dd5c9680 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:03.509516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e4f760fe-1290-407f-864d-58ebb9b3f292 req-a6a44b34-523c-45f2-ace1-a3b1dd5c9680 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:03.510391 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:03.510833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:03.512034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e4f760fe-1290-407f-864d-58ebb9b3f292 req-a6a44b34-523c-45f2-ace1-a3b1dd5c9680 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:03.515352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:03.515865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:03.516321 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:03.550089 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-e4f760fe-1290-407f-864d-58ebb9b3f292 req-a6a44b34-523c-45f2-ace1-a3b1dd5c9680 service nova] Creating event network-vif-plugged:80793cb0-42ec-49e9-9b78-9c29012762c0 for instance ba2e7361-695d-4c7d-8116-00182e81496d on hv-cinder-86026 Oct 04 14:38:03.567236 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-e4f760fe-1290-407f-864d-58ebb9b3f292 req-a6a44b34-523c-45f2-ace1-a3b1dd5c9680 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135044 Oct 04 14:38:03.567848 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 584/1182] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:03.860522 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:03.861495 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:03.872152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:03.873012 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:03.873786 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:03.874763 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:03.875426 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:03.877739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:03.959725 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:03.968750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7937217e-4ef8-430d-b9a1-b28fd952e3d9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1205 microversion: 2.1 time: 0.492441 Oct 04 14:38:03.969443 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 599/1183] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:03 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1205 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:04.196701 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:04.204708 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-26598d16-c596-49ad-b6e4-86030c892477 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.349750 Oct 04 14:38:04.205519 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 585/1184] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:03 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:05.000991 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:05.002697 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:05.020617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:05.021306 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:05.021776 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:05.022488 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:05.022938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:05.023358 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:05.231573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:05.232828 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:05.242852 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:05.244805 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:05.245246 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:05.246155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:05.246620 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:05.247164 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:05.395232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:05.419297 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-581d51b5-ee83-4be8-8fd1-c87ccd830596 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.429021 Oct 04 14:38:05.433123 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 600/1185] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:04 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:05.591645 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:05.608216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-0ad6b4aa-2d67-400f-8db6-17bfa535591d tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1265 microversion: 2.1 time: 0.380148 Oct 04 14:38:05.621142 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 586/1186] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:05 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:38:05.785756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-1ae53867-e753-474c-aafb-c6bb639d62b9 req-bea97a87-fd4f-4133-bdc4-9ce0805dd3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:38:05.828882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-1ae53867-e753-474c-aafb-c6bb639d62b9 req-bea97a87-fd4f-4133-bdc4-9ce0805dd3b8 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:05.831310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-1ae53867-e753-474c-aafb-c6bb639d62b9 req-bea97a87-fd4f-4133-bdc4-9ce0805dd3b8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:05.831913 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-1ae53867-e753-474c-aafb-c6bb639d62b9 req-bea97a87-fd4f-4133-bdc4-9ce0805dd3b8 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:05.855764 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-1ae53867-e753-474c-aafb-c6bb639d62b9 req-bea97a87-fd4f-4133-bdc4-9ce0805dd3b8 service nova] Creating event network-changed:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:38:05.870398 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-1ae53867-e753-474c-aafb-c6bb639d62b9 req-bea97a87-fd4f-4133-bdc4-9ce0805dd3b8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099308 Oct 04 14:38:05.873393 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 601/1187] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:06.461710 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:06.464445 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:06.478593 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:06.479401 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:06.479952 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:06.480876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:06.481602 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:06.482408 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:06.637935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:06.638749 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:06.645835 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:06.647146 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:06.647984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:06.648816 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:06.649514 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:06.649945 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:06.702063 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:06.714775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-dcc6a26e-24d4-4a61-8976-2a4cfdea1b06 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.269528 Oct 04 14:38:06.716430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 587/1188] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:06 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:06.864782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:06.876551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-bea4f342-5048-409f-abad-ec063ff6e937 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1452 microversion: 2.1 time: 0.242761 Oct 04 14:38:06.878619 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 602/1189] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:06 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1452 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:06.901474 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:06.902340 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:06.909880 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:06.910604 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:06.911108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:06.912044 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:06.912632 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:06.913329 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:07.416869 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:07.426935 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-261571b4-61e4-4718-834b-d1abbc98f178 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1452 microversion: 2.1 time: 0.529265 Oct 04 14:38:07.440887 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 588/1190] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:06 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1452 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:07.738351 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:07.740252 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:07.747658 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:07.748462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:07.749059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:07.749929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:07.750542 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:07.751150 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:07.998385 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:08.010423 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-413cc362-24fa-4c2b-8d51-dd94b60b6afb tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.275874 Oct 04 14:38:08.024962 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 603/1191] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:07 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:09.036052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:09.036742 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:09.043287 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:09.043777 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:09.044243 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:09.044983 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:09.045654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:09.046062 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:09.290903 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:09.300096 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-c9557ee7-6c15-4059-99d0-1c864413b64f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.268047 Oct 04 14:38:09.312712 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 589/1192] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:09 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:09.591234 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-737b524e-79a7-4241-a3ef-cef98d165308 req-52c3e08c-3d2b-47da-acb0-0879fc98eb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2e7361-695d-4c7d-8116-00182e81496d", "tag": "80793cb0-42ec-49e9-9b78-9c29012762c0"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:38:09.602819 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-737b524e-79a7-4241-a3ef-cef98d165308 req-52c3e08c-3d2b-47da-acb0-0879fc98eb9b service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:09.603342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-737b524e-79a7-4241-a3ef-cef98d165308 req-52c3e08c-3d2b-47da-acb0-0879fc98eb9b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:09.603774 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-737b524e-79a7-4241-a3ef-cef98d165308 req-52c3e08c-3d2b-47da-acb0-0879fc98eb9b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:09.615481 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-737b524e-79a7-4241-a3ef-cef98d165308 req-52c3e08c-3d2b-47da-acb0-0879fc98eb9b service nova] Creating event network-changed:80793cb0-42ec-49e9-9b78-9c29012762c0 for instance ba2e7361-695d-4c7d-8116-00182e81496d on hv-cinder-86026 Oct 04 14:38:09.620687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-737b524e-79a7-4241-a3ef-cef98d165308 req-52c3e08c-3d2b-47da-acb0-0879fc98eb9b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032938 Oct 04 14:38:09.621796 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 604/1193] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:09.702477 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2e8cccc5-96c3-413a-9c04-ac378d5d4d9e tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f5718743700>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:09.759473 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2e8cccc5-96c3-413a-9c04-ac378d5d4d9e tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/758d95bc-f5e1-4c7c-9857-68380a1692bd" status: 200 len: 351 microversion: 2.1 time: 0.060743 Oct 04 14:38:09.760268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 590/1194] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:38:09 2022] GET /compute/v2.1/os-volumes/758d95bc-f5e1-4c7c-9857-68380a1692bd => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:10.326062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:10.326931 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:10.334609 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:10.335284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:10.335876 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:10.337004 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:10.337563 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:10.338165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:10.487657 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:10.497169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2a0c1311-2f96-4135-9b53-8b91a9b2d2f3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.175675 Oct 04 14:38:10.497948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 605/1195] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:10 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:11.243152 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=2 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:11.243923 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell0:SELECT=6 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:11.248155 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-43a51c69-7fda-4a8c-bd15-4f807d1fdedb tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f5718549ca0>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:11.296404 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-43a51c69-7fda-4a8c-bd15-4f807d1fdedb tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/06cd08ea-73e3-4c89-919a-48a308151ec6" status: 200 len: 348 microversion: 2.1 time: 0.054418 Oct 04 14:38:11.296979 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 591/1196] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:38:11 2022] GET /compute/v2.1/os-volumes/06cd08ea-73e3-4c89-919a-48a308151ec6 => generated 348 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:11.533104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:11.536769 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:11.554748 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell0:SELECT=2 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:11.566198 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:11.566833 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:11.567717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:11.571709 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:11.572581 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:11.573308 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:11.632794 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=100 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:11.766800 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:11.775623 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ad8fd33b-3ba8-4ba4-bc46-0f52616ac820 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.259321 Oct 04 14:38:11.776287 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 606/1197] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:11 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:12.694899 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e8b55769-58ce-406b-aa65-d92cbc70e349 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f5718acdd30>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:12.742237 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e8b55769-58ce-406b-aa65-d92cbc70e349 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8cf62535-bb65-4784-92e4-4a846d3f8b05" status: 200 len: 349 microversion: 2.1 time: 0.052223 Oct 04 14:38:12.742815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 592/1198] 10.222.0.64 () {58 vars in 1245 bytes} [Tue Oct 4 14:38:12 2022] GET /compute/v2.1/os-volumes/8cf62535-bb65-4784-92e4-4a846d3f8b05 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:38:12.756568 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-ef1bc0ee-00da-4ede-b676-636e39ab55c0 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f5718630f70>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:12.798838 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:12.799455 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:12.807969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:12.807969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:12.807969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:12.807969 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:12.808438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:12.808438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:12.855755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-ef1bc0ee-00da-4ede-b676-636e39ab55c0 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.103631 Oct 04 14:38:12.856509 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 607/1199] 10.222.0.64 () {58 vars in 1134 bytes} [Tue Oct 4 14:38:12 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:12.871352 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f2bb3e15-09b4-4812-825f-d6e51c2e3ab7 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f571bf87700>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:12.954189 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:12.963034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-21c622b5-6060-4151-9a39-e9470e3a5263 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.167927 Oct 04 14:38:12.963685 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 593/1200] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:12 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:12.964232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f2bb3e15-09b4-4812-825f-d6e51c2e3ab7 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 690 microversion: 2.1 time: 0.096387 Oct 04 14:38:12.964947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 608/1201] 10.222.0.64 () {58 vars in 1149 bytes} [Tue Oct 4 14:38:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 690 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:38:12.981465 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-1e5d63de-3240-474d-a671-e40109442514 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f5718acde50>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.068007 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-1e5d63de-3240-474d-a671-e40109442514 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.090243 Oct 04 14:38:13.068750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 594/1202] 10.222.0.64 () {58 vars in 1134 bytes} [Tue Oct 4 14:38:12 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:13.083922 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-248acc52-c058-4bea-810c-a35ebea93850 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f571bf875e0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.173547 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-248acc52-c058-4bea-810c-a35ebea93850 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 351 microversion: 2.1 time: 0.094815 Oct 04 14:38:13.174267 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 609/1203] 10.222.0.64 () {58 vars in 1167 bytes} [Tue Oct 4 14:38:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:13.188771 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7e421e29-322d-4497-958a-707cb67ea1d2 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f57184eb280>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.280886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7e421e29-322d-4497-958a-707cb67ea1d2 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 690 microversion: 2.1 time: 0.095910 Oct 04 14:38:13.281501 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 595/1204] 10.222.0.64 () {58 vars in 1170 bytes} [Tue Oct 4 14:38:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 690 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:13.296690 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-78e5af80-94f9-45e4-873d-d3a165642013 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f5718630790>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.380561 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-78e5af80-94f9-45e4-873d-d3a165642013 tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.087110 Oct 04 14:38:13.381331 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 610/1205] 10.222.0.64 () {58 vars in 1155 bytes} [Tue Oct 4 14:38:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:13.394745 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b7cb5172-ab9a-4dfb-bc9d-c5de2e8848fa tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f57184f2a60>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.478475 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b7cb5172-ab9a-4dfb-bc9d-c5de2e8848fa tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 351 microversion: 2.1 time: 0.087543 Oct 04 14:38:13.479074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 596/1206] 10.222.0.64 () {58 vars in 1188 bytes} [Tue Oct 4 14:38:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:13.493093 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7b20bbe5-4b60-4d9f-b2cf-ee644f5df1ad tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] Calling method '.version_select at 0x7f57187d3dc0>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.577101 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7b20bbe5-4b60-4d9f-b2cf-ee644f5df1ad tempest-VolumesTestJSON-881824262 tempest-VolumesTestJSON-881824262-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.088417 Oct 04 14:38:13.577677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 611/1207] 10.222.0.64 () {58 vars in 1155 bytes} [Tue Oct 4 14:38:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:38:13.986179 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:13.986784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:13.993607 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:13.994090 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:13.994516 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:13.995210 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:13.995656 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:13.996073 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:14.134254 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:14.142141 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-7e32a50c-1171-4ffc-8b6f-4b232bd317b0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.160535 Oct 04 14:38:14.142721 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 597/1208] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:13 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:15.171430 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:15.172055 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:15.179702 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:15.180176 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:15.180652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:15.181342 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:15.181785 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:15.182200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:15.322084 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:15.330019 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-7b1b26db-732e-4f47-ad2b-20aa7891b956 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.163553 Oct 04 14:38:15.330597 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 612/1209] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:15 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:16.353324 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:16.353934 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:16.360527 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:16.361069 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:16.361655 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:16.362446 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:16.362997 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:16.363567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:16.507169 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:16.514908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-309e356d-dbdf-494c-947a-cbe9a40024ca tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.166119 Oct 04 14:38:16.515484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 598/1210] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:16 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:17.415829 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-7266eeb9-92e0-4009-ab6c-b74274766441 req-d14659cf-05db-4b82-9383-55f6f5b016e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "name": "network-vif-plugged", "status": "completed", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:38:17.422282 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 14:38:17.422475 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Tue Oct 4 14:38:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.64) !!! Oct 04 14:38:17.430554 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-7266eeb9-92e0-4009-ab6c-b74274766441 req-d14659cf-05db-4b82-9383-55f6f5b016e2 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:17.431476 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-7266eeb9-92e0-4009-ab6c-b74274766441 req-d14659cf-05db-4b82-9383-55f6f5b016e2 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:17.432080 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-7266eeb9-92e0-4009-ab6c-b74274766441 req-d14659cf-05db-4b82-9383-55f6f5b016e2 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:17.444050 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-7266eeb9-92e0-4009-ab6c-b74274766441 req-d14659cf-05db-4b82-9383-55f6f5b016e2 service nova] Creating event network-vif-plugged:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:38:17.449192 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-7266eeb9-92e0-4009-ab6c-b74274766441 req-d14659cf-05db-4b82-9383-55f6f5b016e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037733 Oct 04 14:38:17.449788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 613/1211] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:38:17.543430 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:17.544876 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:17.551148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:17.551630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:17.552106 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:17.553444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:17.553918 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:17.554421 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:17.795881 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:17.813337 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9a4bfbde-d854-426d-b673-c9f9884fb905 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.274276 Oct 04 14:38:17.814411 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 599/1212] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:17 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:38:18.840661 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:18.841631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:18.849665 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:18.850233 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:18.850786 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:18.851536 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:18.852062 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:18.852546 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:19.013082 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:19.022048 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0da70e74-45cd-4616-a1ee-284e401fd7a6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1260 microversion: 2.1 time: 0.188110 Oct 04 14:38:19.022670 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 614/1213] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:18 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:20.051147 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:20.051907 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:20.058988 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:20.059492 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:20.059936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:20.060686 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:20.061148 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:20.061578 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:20.238028 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:20.247323 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-3470b4d7-d078-40a8-9ee3-3370af3e81d5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1444 microversion: 2.1 time: 0.200168 Oct 04 14:38:20.247908 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 600/1214] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:20 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1444 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:20.290250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:38:20.291750 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:38:20.297425 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:38:20.304250 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:20.305097 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:20.305803 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:20.306938 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:20.307736 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:20.308490 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:20.477718 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:38:20.487461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e2b12c9a-7652-4706-a942-4620ca17660e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1444 microversion: 2.1 time: 0.205012 Oct 04 14:38:20.488090 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 615/1215] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:38:20 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1444 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:38:23.514950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-4e888c98-3b15-454d-b9f9-273113cd4363 req-34b96e3d-4b1c-4bd3-b5f5-61b3b98474cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:38:23.530085 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-4e888c98-3b15-454d-b9f9-273113cd4363 req-34b96e3d-4b1c-4bd3-b5f5-61b3b98474cf service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:38:23.530633 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-4e888c98-3b15-454d-b9f9-273113cd4363 req-34b96e3d-4b1c-4bd3-b5f5-61b3b98474cf service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:38:23.531137 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-4e888c98-3b15-454d-b9f9-273113cd4363 req-34b96e3d-4b1c-4bd3-b5f5-61b3b98474cf service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:38:23.551391 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-4e888c98-3b15-454d-b9f9-273113cd4363 req-34b96e3d-4b1c-4bd3-b5f5-61b3b98474cf service nova] Creating event network-changed:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:38:23.566750 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-4e888c98-3b15-454d-b9f9-273113cd4363 req-34b96e3d-4b1c-4bd3-b5f5-61b3b98474cf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055413 Oct 04 14:38:23.568082 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 601/1216] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:39:46.649066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:46.650067 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=22 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:46.652444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:46.653315 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=87 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:39:46.654828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:46.655296 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:46.659365 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-5616ddf4-9473-44c8-87b2-67b47aaf5703 req-f3e852f5-4988-4d93-8e3d-2508e2748b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba2e7361-695d-4c7d-8116-00182e81496d", "tag": "80793cb0-42ec-49e9-9b78-9c29012762c0"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:39:46.662767 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:46.663262 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:46.663698 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:46.664449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:46.665235 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:46.665363 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:46.670649 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5616ddf4-9473-44c8-87b2-67b47aaf5703 req-f3e852f5-4988-4d93-8e3d-2508e2748b9b service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:46.671219 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5616ddf4-9473-44c8-87b2-67b47aaf5703 req-f3e852f5-4988-4d93-8e3d-2508e2748b9b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:46.671651 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-5616ddf4-9473-44c8-87b2-67b47aaf5703 req-f3e852f5-4988-4d93-8e3d-2508e2748b9b service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:46.684223 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-5616ddf4-9473-44c8-87b2-67b47aaf5703 req-f3e852f5-4988-4d93-8e3d-2508e2748b9b service nova] Creating event network-changed:80793cb0-42ec-49e9-9b78-9c29012762c0 for instance ba2e7361-695d-4c7d-8116-00182e81496d on hv-cinder-86026 Oct 04 14:39:46.689719 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-5616ddf4-9473-44c8-87b2-67b47aaf5703 req-f3e852f5-4988-4d93-8e3d-2508e2748b9b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039919 Oct 04 14:39:46.691654 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 602/1217] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:39:46.695310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:39:46.800200 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a254093e-9efc-425e-9296-8c913809bfc1 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 204 len: 0 microversion: 2.1 time: 0.152954 Oct 04 14:39:46.801582 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 616/1218] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:39:46 2022] DELETE /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:39:46.811034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:46.811826 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:46.819036 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:46.819534 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:46.819972 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:46.820917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:46.821375 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:46.821804 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:47.207298 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:39:47.215356 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-626346e7-fe9c-4e98-b261-905ea5c8ec14 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1576 microversion: 2.1 time: 0.408747 Oct 04 14:39:47.216346 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 603/1219] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:46 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1576 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:39:48.241959 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:48.242659 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:48.249310 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:48.249805 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:48.250446 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:48.251165 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:48.251616 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:48.252043 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:48.464249 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:39:48.473174 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-d9982696-4bbf-4742-b69f-2c595ae5b64a tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1576 microversion: 2.1 time: 0.235535 Oct 04 14:39:48.473941 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 617/1220] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:48 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:39:49.497801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:49.498565 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:49.501833 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 14:39:49.502002 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Tue Oct 4 14:39:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d (ip 10.222.0.64) !!! Oct 04 14:39:49.510531 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:49.511301 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:49.511739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:49.512493 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:49.512946 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:49.513369 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:49.526329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-42ea6924-4484-4114-8c64-a1ecf54c8790 req-31f33e67-1f5e-4b5c-9600-514de9dc4b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba2e7361-695d-4c7d-8116-00182e81496d", "name": "network-vif-deleted", "tag": "80793cb0-42ec-49e9-9b78-9c29012762c0"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:39:49.536974 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-42ea6924-4484-4114-8c64-a1ecf54c8790 req-31f33e67-1f5e-4b5c-9600-514de9dc4b20 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:49.537461 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-42ea6924-4484-4114-8c64-a1ecf54c8790 req-31f33e67-1f5e-4b5c-9600-514de9dc4b20 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:49.537894 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-42ea6924-4484-4114-8c64-a1ecf54c8790 req-31f33e67-1f5e-4b5c-9600-514de9dc4b20 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:49.550313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-42ea6924-4484-4114-8c64-a1ecf54c8790 req-31f33e67-1f5e-4b5c-9600-514de9dc4b20 service nova] Creating event network-vif-deleted:80793cb0-42ec-49e9-9b78-9c29012762c0 for instance ba2e7361-695d-4c7d-8116-00182e81496d on hv-cinder-86026 Oct 04 14:39:49.555454 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-42ea6924-4484-4114-8c64-a1ecf54c8790 req-31f33e67-1f5e-4b5c-9600-514de9dc4b20 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Oct 04 14:39:49.555999 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 618/1221] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:39:49.592438 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:39:49.600693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5ca623e1-3bfc-457f-a931-8f19241646f8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 200 len: 1390 microversion: 2.1 time: 0.106749 Oct 04 14:39:49.601483 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 604/1222] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:49 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 1390 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:39:50.625497 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:50.626203 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: ba2e7361-695d-4c7d-8116-00182e81496d] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:50.632590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:50.633077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:50.633516 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:50.634226 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:50.634680 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:50.635105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:50.650083 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] HTTP exception thrown: Instance ba2e7361-695d-4c7d-8116-00182e81496d could not be found. Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Request method failure captured: Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d HTTP/1.1 Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEO2-to1CtDnHGa6mtD2SwxCCzwqpDY4-HJqtrALWXJY0j-tuErw3Xr6ZTWewABRSTZrVWddkpbZ8eOzCeEtqrE_jT0-pkJ1HhY8UR0wfh_nZzLUF8zWb024zog1gYmyPMCIXsNORM64XtvwePZ7OWfiNvUn7R1kQW9FFcpgouRyBU4 Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:39:50.651755 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_408b16a582484c619ff17416990d5feb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/408b16a582484c619ff17416990d5feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: c7028d2ccede4b44b567387bb83c4579 Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance ba2e7361-695d-4c7d-8116-00182e81496d could not be found. Oct 04 14:39:50.653696 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'ba2e7361-695d-4c7d-8116-00182e81496d'} Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba2e7361-695d-4c7d-8116-00182e81496d could not be found. Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:39:50.655541 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba2e7361-695d-4c7d-8116-00182e81496d could not be found. Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba2e7361-695d-4c7d-8116-00182e81496d could not be found. Oct 04 14:39:50.657950 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:50.659525 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Returning 404 to user: Instance ba2e7361-695d-4c7d-8116-00182e81496d could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:39:50.659525 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-80b3530f-f193-430a-ad08-7273e761df0c tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d" status: 404 len: 111 microversion: 2.1 time: 0.032591 Oct 04 14:39:50.659525 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 619/1223] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:50 2022] GET /compute/v2.1/servers/ba2e7361-695d-4c7d-8116-00182e81496d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:39:53.759917 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:53.760517 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:53.768626 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:53.769423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:53.769861 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:53.770575 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:53.771022 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:53.771256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-0a1e4a90-f4b4-49e3-90ca-f2858f81548a req-251c9bcf-edc9-4582-91d0-eb581b511048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e076e5d9-70c2-4624-b6b9-6e0b030d73e5", "tag": "0beda3fd-dcf6-460d-9272-d7d5984b6508"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:39:53.772197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:53.783984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0a1e4a90-f4b4-49e3-90ca-f2858f81548a req-251c9bcf-edc9-4582-91d0-eb581b511048 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:53.784648 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0a1e4a90-f4b4-49e3-90ca-f2858f81548a req-251c9bcf-edc9-4582-91d0-eb581b511048 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:53.785184 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-0a1e4a90-f4b4-49e3-90ca-f2858f81548a req-251c9bcf-edc9-4582-91d0-eb581b511048 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:53.800539 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Going to try to terminate instance {{(pid=120820) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:39:53.803256 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-0a1e4a90-f4b4-49e3-90ca-f2858f81548a req-251c9bcf-edc9-4582-91d0-eb581b511048 service nova] Creating event network-changed:0beda3fd-dcf6-460d-9272-d7d5984b6508 for instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 on hv-cinder-86026 Oct 04 14:39:53.808818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-0a1e4a90-f4b4-49e3-90ca-f2858f81548a req-251c9bcf-edc9-4582-91d0-eb581b511048 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041152 Oct 04 14:39:53.809595 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 620/1224] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 14:39:53.892385 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e8902352-9e95-400e-92f1-d5a36f16e2cd tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 204 len: 0 microversion: 2.1 time: 0.136032 Oct 04 14:39:53.894216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 605/1225] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:39:53 2022] DELETE /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:39:53.903070 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:53.904183 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:53.911118 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:53.911643 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:53.912082 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:53.913022 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:53.913471 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:53.913891 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:54.054765 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:39:54.064673 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aed57638-b096-473f-a3a0-d798e38387e8 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1579 microversion: 2.1 time: 0.165704 Oct 04 14:39:54.065313 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 621/1226] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:53 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:39:55.089974 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:55.090683 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:55.098177 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:55.098505 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:55.098947 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:55.099695 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:55.100150 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:55.100618 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:55.240247 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:39:55.247990 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-5adbb17a-2e07-4187-a256-b2e2abae1d18 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1579 microversion: 2.1 time: 0.162839 Oct 04 14:39:55.248595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 606/1227] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:55 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:39:56.019989 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-7a9136e7-1cb5-4575-b7e0-030385dd0b30 req-aa3947f0-2395-4135-b02a-d07cd27a9183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e076e5d9-70c2-4624-b6b9-6e0b030d73e5", "name": "network-vif-deleted", "tag": "0beda3fd-dcf6-460d-9272-d7d5984b6508"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:39:56.030798 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-7a9136e7-1cb5-4575-b7e0-030385dd0b30 req-aa3947f0-2395-4135-b02a-d07cd27a9183 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:56.031834 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-7a9136e7-1cb5-4575-b7e0-030385dd0b30 req-aa3947f0-2395-4135-b02a-d07cd27a9183 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:56.032937 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-7a9136e7-1cb5-4575-b7e0-030385dd0b30 req-aa3947f0-2395-4135-b02a-d07cd27a9183 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:56.045524 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-7a9136e7-1cb5-4575-b7e0-030385dd0b30 req-aa3947f0-2395-4135-b02a-d07cd27a9183 service nova] Creating event network-vif-deleted:0beda3fd-dcf6-460d-9272-d7d5984b6508 for instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 on hv-cinder-86026 Oct 04 14:39:56.050851 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-7a9136e7-1cb5-4575-b7e0-030385dd0b30 req-aa3947f0-2395-4135-b02a-d07cd27a9183 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Oct 04 14:39:56.051828 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 622/1228] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:39:56.271080 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:56.271660 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:56.278567 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:56.279066 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:56.279603 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:56.280348 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:56.281378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:56.281818 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:56.355334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7028d2ccede4b44b567387bb83c4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '408b16a582484c619ff17416990d5feb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:39:56.365262 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-70f346fd-889d-4b86-bc29-e5f10bf87200 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 200 len: 1225 microversion: 2.1 time: 0.098026 Oct 04 14:39:56.366135 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 607/1229] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:56 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:39:57.391143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:57.391994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e076e5d9-70c2-4624-b6b9-6e0b030d73e5] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:57.398534 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:57.399059 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:57.399449 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:57.400143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:57.400617 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:57.401036 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:57.414308 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] HTTP exception thrown: Instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 could not be found. Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Request method failure captured: Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 HTTP/1.1 Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEO2-to1CtDnHGa6mtD2SwxCCzwqpDY4-HJqtrALWXJY0j-tuErw3Xr6ZTWewABRSTZrVWddkpbZ8eOzCeEtqrE_jT0-pkJ1HhY8UR0wfh_nZzLUF8zWb024zog1gYmyPMCIXsNORM64XtvwePZ7OWfiNvUn7R1kQW9FFcpgouRyBU4 Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:39:57.415956 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_408b16a582484c619ff17416990d5feb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/408b16a582484c619ff17416990d5feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: c7028d2ccede4b44b567387bb83c4579 Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 could not be found. Oct 04 14:39:57.417727 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'e076e5d9-70c2-4624-b6b9-6e0b030d73e5'} Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 could not be found. Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:39:57.418992 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 could not be found. Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 could not be found. Oct 04 14:39:57.420650 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.422969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Returning 404 to user: Instance e076e5d9-70c2-4624-b6b9-6e0b030d73e5 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:39:57.422969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e615ac24-98be-4c73-be8f-2a77c73288aa tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5" status: 404 len: 111 microversion: 2.1 time: 0.031238 Oct 04 14:39:57.422969 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 623/1230] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:57 2022] GET /compute/v2.1/servers/e076e5d9-70c2-4624-b6b9-6e0b030d73e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:39:57.857964 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:57.858507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:57.866197 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:57.866691 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:57.867160 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:57.867864 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:57.868364 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:57.868775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:57.882212 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] HTTP exception thrown: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Request method failure captured: Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: DELETE /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 HTTP/1.1 Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEO2-to1CtDnHGa6mtD2SwxCCzwqpDY4-HJqtrALWXJY0j-tuErw3Xr6ZTWewABRSTZrVWddkpbZ8eOzCeEtqrE_jT0-pkJ1HhY8UR0wfh_nZzLUF8zWb024zog1gYmyPMCIXsNORM64XtvwePZ7OWfiNvUn7R1kQW9FFcpgouRyBU4 Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:39:57.883901 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_408b16a582484c619ff17416990d5feb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/408b16a582484c619ff17416990d5feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: c7028d2ccede4b44b567387bb83c4579 Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.885813 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': 'e7710c92-4b84-4095-8986-a3bc34164760'} Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:39:57.887594 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.889303 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.891188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Returning 404 to user: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:39:57.891188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f12cc3e7-aa13-44a7-a635-084cdb5dd469 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 404 len: 111 microversion: 2.1 time: 0.031323 Oct 04 14:39:57.891188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 608/1231] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:39:57 2022] DELETE /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:39:57.894551 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:57.895171 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] [instance: e7710c92-4b84-4095-8986-a3bc34164760] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:39:57.902017 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:57.902508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:57.902946 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:57.903654 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:39:57.904106 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:39:57.904562 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:39:57.919384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.wsgi [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] HTTP exception thrown: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Request method failure captured: Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: request: GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 HTTP/1.1 Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept: application/json Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Accept-Encoding: identity Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Connection: close Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Length: 0 Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Content-Type: application/json Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Host: 10.222.0.64 Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Openstack-System-Scope: None Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: User-Agent: python-urllib3/1.26.12 Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Auth-Token: gAAAAABjPEO2-to1CtDnHGa6mtD2SwxCCzwqpDY4-HJqtrALWXJY0j-tuErw3Xr6ZTWewABRSTZrVWddkpbZ8eOzCeEtqrE_jT0-pkJ1HhY8UR0wfh_nZzLUF8zWb024zog1gYmyPMCIXsNORM64XtvwePZ7OWfiNvUn7R1kQW9FFcpgouRyBU4 Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Id: None Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Domain-Name: None Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Identity-Status: Confirmed Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Is-Admin-Project: True Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Id: default Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Domain-Name: Default Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Project-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Role: member,reader Oct 04 14:39:57.921009 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Roles: member,reader Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_408b16a582484c619ff17416990d5feb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/408b16a582484c619ff17416990d5feb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/408b16a582484c619ff17416990d5feb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Id: 408b16a582484c619ff17416990d5feb Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-Tenant-Name: tempest-TestVolumeBootPattern-1700600498 Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Id: default Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Domain-Name: Default Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Id: c7028d2ccede4b44b567387bb83c4579 Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: X-User-Name: tempest-TestVolumeBootPattern-1700600498-project Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: method: > Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: exception: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.923646 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: action_args: {'id': 'e7710c92-4b84-4095-8986-a3bc34164760'} Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:39:57.924741 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. Oct 04 14:39:57.926144 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR nova.api.openstack.wsgi Oct 04 14:39:57.927347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Returning 404 to user: Instance e7710c92-4b84-4095-8986-a3bc34164760 could not be found. {{(pid=120821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:39:57.927347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e3202042-0ac7-4458-b179-ed63edd9b27f tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760" status: 404 len: 111 microversion: 2.1 time: 0.033005 Oct 04 14:39:57.927347 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 624/1232] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:39:57 2022] GET /compute/v2.1/servers/e7710c92-4b84-4095-8986-a3bc34164760 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:39:59.240207 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-f552eb71-dd27-4517-b03d-6b1087720643 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] Calling method '.version_select at 0x7f5718ad6f70>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:39:59.267573 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-f552eb71-dd27-4517-b03d-6b1087720643 tempest-TestVolumeBootPattern-1700600498 tempest-TestVolumeBootPattern-1700600498-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1694566594" status: 202 len: 0 microversion: 2.1 time: 0.031153 Oct 04 14:39:59.268687 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 609/1233] 10.222.0.64 () {58 vars in 1263 bytes} [Tue Oct 4 14:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1694566594 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:40:22.168232 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:40:22.169002 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:22.171914 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:22.172621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:22.178999 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:22.179505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:22.179948 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:22.180710 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:22.181169 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:22.181596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:22.209929 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.objects.instance [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lazy-loading 'flavor' on Instance uuid 4a607dd9-3357-4f67-8c0d-64347a31a269 {{(pid=120821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 14:40:22.292133 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5fe39c73-f69e-4c64-beb8-402ada6a657b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "POST /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269/action" status: 202 len: 0 microversion: 2.1 time: 0.127893 Oct 04 14:40:22.292906 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 625/1234] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:40:22 2022] POST /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 14:40:22.301799 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:22.303231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:40:22.310630 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:22.312333 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:22.326423 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:22.327953 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:22.328674 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:22.329595 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:22.330109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:22.330631 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:22.486775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:22.495178 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2632962a-aa77-4b37-9ec4-32d1b85fb539 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.196793 Oct 04 14:40:22.495766 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 610/1235] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:22 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:23.520433 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:23.521143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:23.528439 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:23.529044 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:23.529482 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:23.530258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:23.530712 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:23.531143 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:23.683908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:23.692290 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-476dad3e-3a06-4ab9-bee4-5b58eca0d96a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.176610 Oct 04 14:40:23.692897 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 626/1236] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:23 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:40:24.716393 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:24.716950 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:24.724566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:24.725053 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:24.725485 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:24.726231 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:24.726657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:24.727076 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:24.875050 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:24.883995 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-9eb31952-0fe3-42f6-8351-be48ef9b305a tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.171541 Oct 04 14:40:24.884629 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 611/1237] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:24 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:25.908789 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:25.909414 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:25.916192 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:25.916714 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:25.917156 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:25.917875 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:25.918329 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:25.918756 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:26.070181 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:26.078511 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-b1ce6f36-7017-42f8-8d8e-95ba2d330ae3 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.173765 Oct 04 14:40:26.079096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 627/1238] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:25 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:27.102858 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:27.103398 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:27.110297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:27.110785 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:27.111213 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:27.111956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:27.112505 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:27.112956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:27.259003 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:27.268407 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-a1573cfb-0bb9-455b-a42d-d75913d654b2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.169520 Oct 04 14:40:27.269013 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 612/1239] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:27 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:28.293083 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:28.293733 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:28.300947 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:28.301440 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:28.301877 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:28.302585 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:28.303038 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:28.303462 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:28.464782 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:28.477286 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5d5cf1e0-4124-45f7-b383-56bbf99f402b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.187712 Oct 04 14:40:28.478311 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 628/1240] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:28 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:29.502819 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:29.503449 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:29.510444 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:29.510937 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:29.511370 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:29.512092 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:29.512590 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:29.513017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:29.664663 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:29.672820 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d9b7c24d-35a1-4025-90ee-48d62130ae11 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.175156 Oct 04 14:40:29.673415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 613/1241] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:29 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:30.693668 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f45ab88-4326-4107-a579-f6899a6c9d8f] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 14:40:30.697268 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:30.697889 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:30.704669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:30.705088 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:30.705525 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:30.706225 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:30.706674 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:30.707096 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:30.838020 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:30.845924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-a612190d-3d8d-488b-b15a-7b39111fe0df tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.153769 Oct 04 14:40:30.846486 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 629/1242] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:30 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:31.868670 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:31.869234 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:31.875879 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:31.876380 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:31.876815 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:31.877509 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:31.877956 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:31.878371 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:32.019753 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:32.027791 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-d4d719e4-61f3-4e56-b22f-fbc85b831ca1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.163372 Oct 04 14:40:32.028389 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 614/1243] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:31 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:33.051818 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:33.052483 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:33.066972 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:33.067459 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:33.067896 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:33.068640 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:33.069094 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:33.069550 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:33.074672 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f45ab88-4326-4107-a579-f6899a6c9d8f] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 38528. Oct 04 14:40:33.211472 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:33.222795 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-2a686065-6006-42b1-b265-d09a702060a2 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.174328 Oct 04 14:40:33.223677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 630/1244] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:33 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:34.247415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:34.248011 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:34.254735 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:34.255216 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:34.255647 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:34.256353 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:34.256807 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:34.257227 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:34.400482 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:34.409034 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-4b62333c-4d89-4c78-b1f8-81a912d9f3a0 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.165517 Oct 04 14:40:34.409614 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 615/1245] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:34 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:35.432930 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:35.433788 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:35.441025 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:35.441505 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:35.441933 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:35.442627 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:35.443073 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:35.443520 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:35.592994 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:35.602145 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f47452d3-2ab2-41c9-91ad-7ad9726e0da4 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1570 microversion: 2.1 time: 0.173106 Oct 04 14:40:35.602984 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 631/1246] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:35 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:35.631657 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:40:35.632494 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:35.642467 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:35.643524 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:35.644041 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:35.644800 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:35.645510 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:35.646282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:35.682738 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120820) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 14:40:35.774058 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-951ab4e4-171a-4cb2-bbd0-ac223bbee8f5 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "POST /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269/action" status: 202 len: 0 microversion: 2.1 time: 0.146943 Oct 04 14:40:35.774775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 616/1247] 10.222.0.64 () {60 vars in 1278 bytes} [Tue Oct 4 14:40:35 2022] POST /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 14:40:35.786677 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:35.788220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:35.794846 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:35.795421 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:35.795921 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:35.796717 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:35.797214 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:35.799220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:35.958066 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:35.968560 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-0cba98e2-1320-4a0a-a88c-7f2ee0f4d336 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1518 microversion: 2.1 time: 0.188947 Oct 04 14:40:35.969164 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 632/1248] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:35 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:36.993585 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:36.994198 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:37.000936 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:37.001359 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:37.001801 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:37.002513 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:37.002978 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:37.003410 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:37.142055 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:37.150091 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-ac063052-a83a-4c31-a773-49ff86ecf054 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1520 microversion: 2.1 time: 0.160861 Oct 04 14:40:37.150659 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 617/1249] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:36 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 14:40:38.174315 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:38.174939 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:38.181305 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:38.181793 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:38.182236 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:38.182935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:38.183386 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:38.183809 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:38.322654 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:38.331005 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-4a95320b-74c4-4daa-bfe0-1e60c867ec7e tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.161277 Oct 04 14:40:38.331596 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 633/1250] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:38 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:39.353653 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:39.354267 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:39.361209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:39.361698 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:39.362139 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:39.362846 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:39.363302 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:39.363729 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:39.501386 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:39.509693 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-e140fdd6-1409-4d8a-8530-0a36a7da4a4b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.160106 Oct 04 14:40:39.510283 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 618/1251] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:39 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:39.827359 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [req-d3e1d7b9-cd79-46e3-8dd8-130548759d29 req-5c26297c-6551-49d2-9b40-5012bc4b2618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "name": "network-vif-unplugged", "status": "completed", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:40:39.848975 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d3e1d7b9-cd79-46e3-8dd8-130548759d29 req-5c26297c-6551-49d2-9b40-5012bc4b2618 service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:39.849478 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d3e1d7b9-cd79-46e3-8dd8-130548759d29 req-5c26297c-6551-49d2-9b40-5012bc4b2618 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:39.849904 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [req-d3e1d7b9-cd79-46e3-8dd8-130548759d29 req-5c26297c-6551-49d2-9b40-5012bc4b2618 service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:39.867438 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.compute.server_external_events [req-d3e1d7b9-cd79-46e3-8dd8-130548759d29 req-5c26297c-6551-49d2-9b40-5012bc4b2618 service nova] Creating event network-vif-unplugged:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:40:39.872832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [req-d3e1d7b9-cd79-46e3-8dd8-130548759d29 req-5c26297c-6551-49d2-9b40-5012bc4b2618 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054978 Oct 04 14:40:39.873470 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 634/1252] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:40:40.534415 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:40.535017 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:40.541764 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:40.542245 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:40.542674 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:40.543372 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:40.543823 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:40.544240 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:40.687443 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:40.695228 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-bfbeeda1-17f9-48ce-b498-080628230bc6 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.165352 Oct 04 14:40:40.695775 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 619/1253] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:40 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:41.719258 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:41.719858 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:41.726199 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:41.726687 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:41.727122 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:41.727827 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:41.728284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:41.728738 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:41.866104 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:41.874669 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f0080651-8b6f-410e-af44-528ffb93eb51 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.159661 Oct 04 14:40:41.875364 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 635/1254] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:41 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:42.898868 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:42.899484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:42.906615 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:42.907097 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:42.907535 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:42.908244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:42.908748 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:42.909176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:43.040244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:43.048981 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2e785e60-d746-466b-873a-a05ff38e9900 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.154294 Oct 04 14:40:43.049566 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 620/1255] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:42 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:44.073683 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:44.074237 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:44.080979 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:44.081453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:44.081882 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:44.082602 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:44.083049 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:44.083465 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:44.216519 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:44.224716 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-6bb552d2-9621-459c-a63a-f32bdbe56dee tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.154874 Oct 04 14:40:44.225330 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 636/1256] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:44 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:45.249182 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:45.249784 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:45.256378 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:45.256867 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:45.257334 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:45.258029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:45.258484 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:45.258913 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:45.399009 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:45.407586 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-b3e22954-ea06-40c9-afaa-6aaf6fb2bd91 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1576 microversion: 2.1 time: 0.162822 Oct 04 14:40:45.408172 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 621/1257] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:45 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:46.430631 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:40:46.431239 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:40:46.438893 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:46.439384 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:46.439817 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:46.440555 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:46.441003 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:46.441422 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:46.574105 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:40:46.581908 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-e53bbb7c-6766-48f5-add6-0550eeb09496 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1563 microversion: 2.1 time: 0.155236 Oct 04 14:40:46.582492 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 637/1258] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:40:46 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:40:47.904688 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-122716d4-8042-4538-85b8-ca8fb3d438de req-e13373ef-4e92-4dd1-951d-732e4de765aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "name": "network-vif-plugged", "status": "completed", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:40:47.918376 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-122716d4-8042-4538-85b8-ca8fb3d438de req-e13373ef-4e92-4dd1-951d-732e4de765aa service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:40:47.919188 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-122716d4-8042-4538-85b8-ca8fb3d438de req-e13373ef-4e92-4dd1-951d-732e4de765aa service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:40:47.919739 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-122716d4-8042-4538-85b8-ca8fb3d438de req-e13373ef-4e92-4dd1-951d-732e4de765aa service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:40:47.932330 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-122716d4-8042-4538-85b8-ca8fb3d438de req-e13373ef-4e92-4dd1-951d-732e4de765aa service nova] Creating event network-vif-plugged:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:40:47.939778 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-122716d4-8042-4538-85b8-ca8fb3d438de req-e13373ef-4e92-4dd1-951d-732e4de765aa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040524 Oct 04 14:40:47.940429 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 622/1259] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:41:57.773635 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_api:SELECT=26 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:57.777327 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a30f28d9-21fa-4780-850f-7b48e4027d0c] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 14:41:57.778094 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:57.778453 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG dbcounter [-] [120821] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:57.779268 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG dbcounter [-] [120820] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 14:41:57.780637 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 14:41:57.780832 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Tue Oct 4 14:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 (ip 10.222.0.64) !!! Oct 04 14:41:57.783605 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 14:41:57.783746 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: Tue Oct 4 14:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 (ip 10.222.0.64) !!! Oct 04 14:41:57.794467 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:41:57.795052 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:41:57.806652 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:57.807243 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:57.807752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:57.808628 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:57.809314 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:57.809935 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:57.841924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Going to try to terminate instance {{(pid=120821) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 14:41:57.866052 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-6be98feb-7e66-41de-9799-1078e5ed8a6a req-f09ff04f-eb91-4b58-b1e0-51a3c79ff86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:41:57.876252 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-6be98feb-7e66-41de-9799-1078e5ed8a6a req-f09ff04f-eb91-4b58-b1e0-51a3c79ff86f service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:57.876680 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-6be98feb-7e66-41de-9799-1078e5ed8a6a req-f09ff04f-eb91-4b58-b1e0-51a3c79ff86f service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:57.877109 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-6be98feb-7e66-41de-9799-1078e5ed8a6a req-f09ff04f-eb91-4b58-b1e0-51a3c79ff86f service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:57.889435 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-6be98feb-7e66-41de-9799-1078e5ed8a6a req-f09ff04f-eb91-4b58-b1e0-51a3c79ff86f service nova] Creating event network-changed:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:41:57.895282 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-6be98feb-7e66-41de-9799-1078e5ed8a6a req-f09ff04f-eb91-4b58-b1e0-51a3c79ff86f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119435 Oct 04 14:41:57.896507 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 623/1260] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:41:57.926924 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-6f1fc1bd-2c61-4da1-8c62-6ced458d964f tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 204 len: 0 microversion: 2.1 time: 0.155069 Oct 04 14:41:57.927537 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 638/1261] 10.222.0.64 () {58 vars in 1239 bytes} [Tue Oct 4 14:41:57 2022] DELETE /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 14:41:57.936911 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:41:57.938129 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:41:57.947176 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:57.948439 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:57.949184 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:57.950218 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:57.951297 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:57.951965 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:58.106743 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.policy [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120820) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:41:58.115026 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-24ad086a-799d-4f74-986f-370c24508921 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.182744 Oct 04 14:41:58.115605 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 624/1262] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:41:57 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:41:59.139590 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:41:59.140284 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:41:59.147125 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:59.147600 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:59.148032 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:59.148752 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:41:59.149205 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:41:59.149621 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:41:59.288424 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:41:59.296395 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-aa0ad224-eccd-4545-9a65-53dd5bbf24d1 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1569 microversion: 2.1 time: 0.161027 Oct 04 14:41:59.296973 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 639/1263] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:41:59 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:42:00.112601 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [req-e6075d2e-7bb0-4fbe-8fc0-4aefe550da60 req-db0617e7-0d10-4959-a591-0f88bb5974ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a607dd9-3357-4f67-8c0d-64347a31a269", "name": "network-vif-deleted", "tag": "ce73e1dc-607e-4614-930c-2b11c9806a9a"}]} {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 14:42:00.125108 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e6075d2e-7bb0-4fbe-8fc0-4aefe550da60 req-db0617e7-0d10-4959-a591-0f88bb5974ec service nova] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:42:00.125598 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e6075d2e-7bb0-4fbe-8fc0-4aefe550da60 req-db0617e7-0d10-4959-a591-0f88bb5974ec service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:42:00.126029 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [req-e6075d2e-7bb0-4fbe-8fc0-4aefe550da60 req-db0617e7-0d10-4959-a591-0f88bb5974ec service nova] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:42:00.141769 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.compute.server_external_events [req-e6075d2e-7bb0-4fbe-8fc0-4aefe550da60 req-db0617e7-0d10-4959-a591-0f88bb5974ec service nova] Creating event network-vif-deleted:ce73e1dc-607e-4614-930c-2b11c9806a9a for instance 4a607dd9-3357-4f67-8c0d-64347a31a269 on hv-cinder-86026 Oct 04 14:42:00.148209 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [req-e6075d2e-7bb0-4fbe-8fc0-4aefe550da60 req-db0617e7-0d10-4959-a591-0f88bb5974ec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039231 Oct 04 14:42:00.149214 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 625/1264] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Oct 4 14:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 14:42:00.319943 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:42:00.320508 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.compute.api [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120821) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:42:00.326964 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:42:00.327452 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:42:00.327886 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:42:00.328620 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:42:00.329077 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:42:00.329499 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG oslo_concurrency.lockutils [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:42:00.399220 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.policy [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fb70b5ab4942a38771709eeb3a5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ffb6098014feb89d5d6f61832b03b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120821) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 14:42:00.407865 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-f4736cd3-6242-4749-a326-4ff30844b690 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 200 len: 1220 microversion: 2.1 time: 0.092542 Oct 04 14:42:00.408491 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 640/1265] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:42:00 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 14:42:01.432532 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '>' {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:42:01.433225 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.compute.api [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] [instance: 4a607dd9-3357-4f67-8c0d-64347a31a269] Fetching instance by UUID {{(pid=120820) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 14:42:01.437244 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO oslo.messaging._drivers.impl_rabbit [-] [a30f28d9-21fa-4780-850f-7b48e4027d0c] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 38624. Oct 04 14:42:01.441996 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:42:01.442480 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:42:01.442916 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:42:01.443621 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Acquiring lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 14:42:01.444074 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 14:42:01.444528 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG oslo_concurrency.lockutils [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Lock "8d0b2b96-fdc7-4407-8ca1-86c8c8070a51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 14:42:01.458238 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.wsgi [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] HTTP exception thrown: Instance 4a607dd9-3357-4f67-8c0d-64347a31a269 could not be found. Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Request method failure captured: Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: request: GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 HTTP/1.1 Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept: application/json Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Accept-Encoding: identity Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Connection: close Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Length: 0 Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Content-Type: application/json Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Host: 10.222.0.64 Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: Openstack-System-Scope: None Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: User-Agent: python-urllib3/1.26.12 Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Auth-Token: gAAAAABjPEUraVkyUQ62XgE0jIiS617z-JiSq-C_VnlWwrrfW5GQzz3CBUI2AixgyG3bQ1S1XVh2cJg_gzigb7JBDa5YKXF6qKxYpTmXlWBgxd8MmUn8DQC2g77A5X4uhVk8SWAUOdyQqvqykMcmsYwNw1K_nervReejlHVLZ3-OvJr-IJBpDrY Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Id: None Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Domain-Name: None Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Identity-Status: Confirmed Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Is-Admin-Project: True Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Id: default Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Domain-Name: Default Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Id: bf0ffb6098014feb89d5d6f61832b03b Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Project-Name: tempest-TestShelveInstance-1523421449 Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Role: member,reader Oct 04 14:42:01.459886 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Roles: member,reader Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/bf0ffb6098014feb89d5d6f61832b03b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_bf0ffb6098014feb89d5d6f61832b03b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/bf0ffb6098014feb89d5d6f61832b03b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/bf0ffb6098014feb89d5d6f61832b03b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}] Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant: tempest-TestShelveInstance-1523421449 Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Id: bf0ffb6098014feb89d5d6f61832b03b Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-Tenant-Name: tempest-TestShelveInstance-1523421449 Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User: tempest-TestShelveInstance-1523421449-project Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Id: default Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Domain-Name: Default Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Id: 33fb70b5ab4942a38771709eeb3a5789 Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: X-User-Name: tempest-TestShelveInstance-1523421449-project Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: method: > Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: exception: Instance 4a607dd9-3357-4f67-8c0d-64347a31a269 could not be found. Oct 04 14:42:01.461747 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: action_args: {'id': '4a607dd9-3357-4f67-8c0d-64347a31a269'} Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: {{(pid=120820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a607dd9-3357-4f67-8c0d-64347a31a269 could not be found. Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 14:42:01.462772 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a607dd9-3357-4f67-8c0d-64347a31a269 could not be found. Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a607dd9-3357-4f67-8c0d-64347a31a269 could not be found. Oct 04 14:42:01.464547 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: ERROR nova.api.openstack.wsgi Oct 04 14:42:01.466261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: DEBUG nova.api.openstack.wsgi [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Returning 404 to user: Instance 4a607dd9-3357-4f67-8c0d-64347a31a269 could not be found. {{(pid=120820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 14:42:01.466261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: INFO nova.api.openstack.requestlog [None req-2dffa616-0503-41fc-b239-73ef2ecb634b tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269" status: 404 len: 111 microversion: 2.1 time: 0.033069 Oct 04 14:42:01.466261 dv-cinder-860260-1-iscsi devstack@n-api.service[120820]: [pid: 120820|app: 0|req: 626/1266] 10.222.0.64 () {58 vars in 1236 bytes} [Tue Oct 4 14:42:01 2022] GET /compute/v2.1/servers/4a607dd9-3357-4f67-8c0d-64347a31a269 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 14:42:01.625366 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: DEBUG nova.api.openstack.wsgi [None req-5e16fc06-8b53-4895-81a8-15bcb36b93c9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] Calling method '.version_select at 0x7f5718630700>' {{(pid=120821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 14:42:01.655457 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: INFO nova.api.openstack.requestlog [None req-5e16fc06-8b53-4895-81a8-15bcb36b93c9 tempest-TestShelveInstance-1523421449 tempest-TestShelveInstance-1523421449-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1583935714" status: 202 len: 0 microversion: 2.1 time: 0.033894 Oct 04 14:42:01.656053 dv-cinder-860260-1-iscsi devstack@n-api.service[120821]: [pid: 120821|app: 0|req: 641/1267] 10.222.0.64 () {58 vars in 1254 bytes} [Tue Oct 4 14:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1583935714 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)